-- Logs begin at Thu 2022-09-22 21:30:47 UTC, end at Thu 2022-09-22 22:37:39 UTC. -- Sep 22 22:01:20.323374 dv-cinder-849143-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 22:01:20.332125 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 22:01:20 2022] *** Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: nodename: dv-cinder-849143-6-iscsi Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: machine: x86_64 Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: clock source: unix Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: pcre jit disabled Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: detected number of CPU cores: 4 Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: current working directory: / Sep 22 22:01:20.334157 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: detected binary path: /usr/bin/uwsgi-core Sep 22 22:01:20.334874 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: your processes number limit is 47680 Sep 22 22:01:20.334874 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: your memory page size is 4096 bytes Sep 22 22:01:20.334874 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: detected max file descriptor number: 2048 Sep 22 22:01:20.334874 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: lock engine: pthread robust mutexes Sep 22 22:01:20.334874 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: thunder lock: enabled Sep 22 22:01:20.334874 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 22:01:20.334874 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 22:01:20.375410 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: Python main interpreter initialized at 0x55cb97ec59c0 Sep 22 22:01:20.375410 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: python threads support enabled Sep 22 22:01:20.375410 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: your server socket listen backlog is limited to 100 connections Sep 22 22:01:20.375410 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: your mercy for graceful operations on workers is 90 seconds Sep 22 22:01:20.375780 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 22:01:20.375864 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: *** Operational MODE: preforking *** Sep 22 22:01:20.376084 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: *** uWSGI is running in multiple interpreter mode *** Sep 22 22:01:20.376084 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: spawned uWSGI master process (pid: 105643) Sep 22 22:01:20.376280 dv-cinder-849143-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 22:01:20.376964 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: spawned uWSGI worker 1 (pid: 105644, cores: 1) Sep 22 22:01:20.377374 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: spawned uWSGI worker 2 (pid: 105645, cores: 1) Sep 22 22:01:20.377374 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 22:01:21.042984 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 22:01:21.045511 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 22:01:22.120810 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 22:01:22.120810 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: from cryptography.utils import int_from_bytes Sep 22 22:01:22.121400 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 22:01:22.121400 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: from cryptography.utils import int_from_bytes Sep 22 22:01:22.122687 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 22:01:22.122687 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: from cryptography.utils import int_from_bytes Sep 22 22:01:22.123118 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 22:01:22.123118 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: from cryptography.utils import int_from_bytes Sep 22 22:01:24.639404 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 22:01:24.639979 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 22:01:24.640175 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 22:01:24.640294 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 22:01:24.640655 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 22:01:24.640740 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 22:01:24.640740 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 22:01:24.641008 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 22:01:24.641150 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.641402 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 22:01:24.641509 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.641655 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 22:01:24.641779 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.642033 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.642127 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.642351 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.642438 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.642665 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.642762 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.642977 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.643082 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.643292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.643384 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.643593 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.643679 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.643852 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.643946 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.644159 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.644251 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.644477 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-6-iscsi {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.644564 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.644735 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.644818 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.645041 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.645148 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.645381 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-6-iscsi {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.645475 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.645687 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.645780 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.645983 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.646076 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.646292 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.646387 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.646587 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.646676 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.646883 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.647075 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.647177 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.648321 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.648465 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.648465 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.648657 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.648762 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.648852 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.648938 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.649024 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.649143 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.649229 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.649324 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.649418 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.649499 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.649578 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.649713 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.649804 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.650028 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.650130 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.650334 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.650428 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.650695 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.650790 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-6-iscsi {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.650996 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.651084 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.651309 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.651403 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-6-iscsi {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.651616 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.651710 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.651963 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.652048 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.652269 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.652385 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.652601 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.652689 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.652930 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.653034 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.653272 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.653382 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.653565 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.653661 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.653875 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.653969 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.654178 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.654264 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.654487 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.654573 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.654796 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.654887 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.655089 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.655175 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.655393 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.655481 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.655687 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.655780 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.655986 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.656072 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.656281 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.656375 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.656578 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.656710 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.656821 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.656916 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.657144 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.657305 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.657400 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.657489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.657699 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.657797 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.658010 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.658108 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.658299 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.658400 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.658545 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.658635 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.658855 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.658944 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.659101 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.659201 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.659410 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.659511 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.659723 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.659811 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.660022 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.660110 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.660321 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.660417 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.660620 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.660720 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.660916 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.661008 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.661234 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.661337 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.661534 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.661629 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.661831 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.661938 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.662126 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.662230 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.662434 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.662521 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.662734 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.662821 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.663044 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.663133 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.663955 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.664118 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.664268 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.664420 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.664588 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.664681 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.664886 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.664984 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.665209 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.665302 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.665542 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.665633 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.665854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.665943 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.666155 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.666244 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.666465 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.666562 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.666766 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.666866 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.667067 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.667165 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.667368 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.667457 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.667667 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.667761 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.667978 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.668075 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.668222 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.668316 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.668517 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.668609 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.668809 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.668908 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.669115 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.669206 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.669417 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.669504 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.669718 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.669817 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.670014 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.670100 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.670309 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.670410 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.670604 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.670699 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.670895 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.670982 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.671190 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.671277 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.671487 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.671574 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.671782 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.671867 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.672079 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.672167 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.672374 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.672462 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.672668 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.672753 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.672964 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.673063 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.673282 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.673375 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.673581 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.673668 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.673877 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.673980 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.674180 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.674289 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.674477 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.674575 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.674773 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.674858 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.675069 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.675159 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.675362 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.675451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.675658 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.675752 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.675957 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.676045 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.676251 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.676336 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.676547 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.676642 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.676843 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.676958 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.677168 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.677274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.677467 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.677570 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.677764 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.677852 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.678059 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.678151 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.678354 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.678468 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.678654 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.678753 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.679602 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.679715 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.679862 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.679980 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.680136 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.680436 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.680522 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.680733 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.680827 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.681028 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.681142 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.681347 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.681434 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.681645 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.681734 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.681940 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.682026 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.682232 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.682317 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.682523 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.682621 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.682811 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.682904 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.683120 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.683221 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.683426 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.683537 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.683720 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.683806 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.684015 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.684101 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.684311 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.684413 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.684620 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:01:24.684708 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.684946 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.685084 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.685293 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.685397 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.685599 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.685685 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.685920 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.686007 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.686242 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.686332 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.686552 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.686637 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.686859 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.686944 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.687160 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.687250 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.687464 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.687558 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.687768 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.687855 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.688069 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.688156 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.688370 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.688464 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.688739 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.688851 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.688981 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.689086 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.689313 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.689404 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.689633 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.689719 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.689939 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.690028 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.690246 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.690334 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.690554 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.690654 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.690858 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.690954 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.691166 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.691262 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.691476 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.691649 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.691780 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.691869 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.692079 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.692172 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.692409 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.692505 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.692742 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.692829 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.693047 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.693165 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.693387 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.693541 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.693692 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.693779 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.694345 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.694476 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.694744 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.694839 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.694909 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.694974 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.695040 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.695106 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.695347 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.695453 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.695661 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.695750 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.695968 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.696055 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.696287 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.696377 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.696597 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.696684 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.696902 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.696989 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.697227 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.697331 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.697535 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.697623 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.697838 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.697924 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.698139 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.698234 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.698463 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.698562 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.698786 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.698926 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.699080 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.699175 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.699388 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.699477 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.699689 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.699784 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.699992 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.700078 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.700292 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.700384 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.700594 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.700690 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.700891 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.700977 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.701211 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.701303 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.701507 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.701606 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.701804 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.701891 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.702098 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.702191 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.702391 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.702478 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.702701 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.702788 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.703000 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.703084 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.703304 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.703391 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.703609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.703705 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.703913 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.704126 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.704264 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.704360 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.704537 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.704626 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.705125 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.705221 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.705419 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.705509 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.705725 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.705812 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.706022 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.706121 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.706320 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.706406 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.706628 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.706713 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.706927 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.707026 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.707224 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.707354 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.707533 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.707630 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.707829 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.707923 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.708128 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.708216 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.708431 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.708518 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.708732 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.708831 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.709035 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.709155 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.709363 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.709452 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.709666 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.709755 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.709976 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.710061 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.710337 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.710440 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.710739 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.710826 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.711114 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.711200 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.711440 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.711526 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.711741 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.711837 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.712058 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.712145 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.712370 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.712455 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.712669 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.712757 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.712965 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.713051 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.713288 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.713386 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.713585 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.713670 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.713883 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.713978 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.714177 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.714276 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.714471 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.714558 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.714763 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.714852 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.715058 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.715159 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.715356 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.715451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.715652 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.715738 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.715947 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.716043 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.716260 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.716348 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.716555 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.716641 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.716850 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.716937 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.717165 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.717255 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.717463 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.717550 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.717792 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.717886 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.718090 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.718175 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.718423 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.718511 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.718746 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.718840 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.719056 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.719149 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.719362 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.719448 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.719666 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.719754 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.719968 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.720053 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.720271 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.720438 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.720574 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.720663 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.720877 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.720971 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.721202 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.721305 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.721512 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.721601 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.721815 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.721914 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.722129 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.722244 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.722422 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.722522 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.722732 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.722819 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.723033 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.723127 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.723335 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.723425 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.723634 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.723775 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.723942 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.724043 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.724273 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.724361 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.724585 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.724671 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.724894 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.724991 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.725223 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.725314 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.725531 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.725616 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.726451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.726563 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.726734 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.726823 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.727091 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.727190 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.727329 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.727419 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.727638 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.727736 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.727944 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.728029 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.728244 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.728339 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.728551 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.728637 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.728851 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.728946 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.729184 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.729272 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.729488 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.729584 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.729790 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.729885 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.730087 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.730181 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.730395 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.730482 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.730717 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.730812 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.731027 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.731114 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.731335 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.731422 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.731640 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.731739 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.731943 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.732037 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.732247 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.732332 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.732548 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.732636 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.732844 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.732929 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.733163 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.733253 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.733463 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.733553 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.733767 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.733855 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.734071 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.734166 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.734373 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.734497 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.734671 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.734764 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.734967 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.735062 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.735271 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.735366 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.735570 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.735663 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.735866 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.735953 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.736161 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.736257 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.736464 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.736552 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.736770 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.736864 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.737073 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.737187 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.737408 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.737497 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.737707 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.737803 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.738007 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.738096 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.738301 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.738387 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.738616 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.738711 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.738912 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.739004 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.739208 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.739295 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.739505 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.739609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.739801 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.739890 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.740141 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.740264 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.740438 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.740547 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.740733 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.740830 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.741042 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.741173 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.741375 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.741526 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.741729 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.741892 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.742039 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.742131 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.742327 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.742419 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.742629 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.742717 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.742944 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.743039 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.743248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.743338 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.743551 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.743645 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.743854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.743951 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.744160 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.744255 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.744459 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.744556 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.744763 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.744861 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.745072 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.745196 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.745397 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.745535 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.745702 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.745799 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.746004 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.746099 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.746301 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.746387 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.746605 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.746704 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.746917 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.747161 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.747473 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.747563 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.747792 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.747905 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.748102 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.748196 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.748418 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.748505 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.748749 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.748858 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.749062 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.749249 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.749412 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.749573 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.749726 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.749874 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.750011 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.750157 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.750294 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.750429 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.750597 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.750737 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.750889 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.751025 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.751169 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.751304 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.751466 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.751608 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.751752 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.751891 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.752033 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.752179 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.752316 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.752451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.752625 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.752767 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.752904 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.753039 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.753203 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.753293 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.753498 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.753588 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.753799 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.753887 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.754122 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.754227 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.754396 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.754484 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.754694 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.754781 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.754991 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.755143 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.755308 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.755395 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.755609 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.755703 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.755908 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.756008 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.756203 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.756290 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.756498 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.756587 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.756831 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.756925 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.757171 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.757314 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.757508 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.757694 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.757882 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.758034 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.758222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.758338 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.758526 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.758641 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.758844 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.758980 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.759147 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.759236 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.759447 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.759573 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.759748 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.759837 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.760046 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.760144 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.760350 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.760445 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.760653 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.760748 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.760948 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.761043 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.761275 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.761378 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.761580 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.761675 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.761883 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.761973 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.762179 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.762274 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.762473 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.762559 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.762770 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.762864 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.763064 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.763162 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.763480 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.763567 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.763783 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.764032 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.764226 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.764364 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.764666 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.764759 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.764976 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.765302 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.765404 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.765605 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.765836 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.765923 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.766197 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.766403 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.766519 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.766795 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.766965 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.767095 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.767399 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.767556 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.767706 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.768010 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.768096 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.768307 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.768626 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.768713 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.768932 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.769250 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.769344 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.769548 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.769819 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.769921 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.770138 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.770386 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.770475 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.770724 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.770960 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.771057 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.771339 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.771561 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.771648 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.771928 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.772133 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.772230 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.772512 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.773413 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.773542 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.773809 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.774026 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.774342 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.774434 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.775045 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.775151 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.775235 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.775372 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.775463 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.775544 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.775661 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.775821 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.776006 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.776167 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.776336 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.776425 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.776649 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.776736 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.776969 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.777066 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.777308 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.777405 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.777619 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.777709 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.777928 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.778024 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.778242 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.778332 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.778563 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.778651 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.778951 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.779038 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.779269 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.779506 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.779596 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.779873 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.780040 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.780173 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.780483 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.780594 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.780790 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.781139 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.781242 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.781421 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.781721 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.781807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.782040 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.782340 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.782436 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.782646 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.782896 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.782982 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.783268 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.783464 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.783589 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.783888 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.784104 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.784198 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.784486 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.784666 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.784791 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.785094 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.785353 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.785500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.785718 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.785932 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.786029 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.786314 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.786510 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.786605 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.786908 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.787113 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.787201 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.787506 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.787695 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.787810 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.788109 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.789254 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.789363 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.789525 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.789665 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.789829 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.789999 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.790149 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.790286 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.790430 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.790606 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.790740 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.790932 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.791071 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.791247 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.791422 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.791556 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.791732 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.791883 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.792040 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.792178 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.792341 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.792473 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.792643 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.792783 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.792947 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.793122 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.793282 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.793452 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.793591 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.793762 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.793889 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.794075 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.794297 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.794385 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.794602 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.794690 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.794905 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.794993 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.795210 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.795305 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.795509 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.795605 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.795806 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.795895 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.796109 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.796195 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.796427 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.796516 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.796727 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.796814 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.797025 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.797140 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.797350 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.797438 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.797665 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.797763 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.797965 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.798061 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.798279 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.798367 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.798584 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.798670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.798886 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.799023 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.799191 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.799279 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.799494 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.799659 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.799801 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.799967 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.800102 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.800272 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.800529 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.800623 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.800840 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.800937 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.801170 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.801274 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.801473 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.801563 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.801782 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.801872 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.802090 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.802178 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.802403 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.802497 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.802713 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.802809 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.803014 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.803104 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.803321 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.803414 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.803619 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.803707 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.803957 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.804060 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.804277 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.804382 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.804621 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.804709 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.804922 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.805021 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.805254 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.805426 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.805579 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.805745 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.805881 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.806052 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.806182 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.806366 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.806483 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.806685 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.806803 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.806984 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.807107 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.807288 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.807425 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.807593 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.807835 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.807923 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.808143 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.808232 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.808448 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.808549 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.808762 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.808849 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.809066 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.809189 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.809393 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.809521 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.809696 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.809785 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.809992 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.810131 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.810288 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.810390 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.810605 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.810700 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.810902 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.810998 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.811216 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.811305 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.811522 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.811611 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.811835 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.811923 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.812148 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.812236 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.812444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.812531 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.812753 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.812848 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.813054 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.813170 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.813374 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.813470 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.813672 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.813776 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.813968 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.814057 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.814301 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.814415 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.814598 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.814735 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.814912 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.815032 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.815232 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.815350 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.815552 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.815672 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.815855 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.815975 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.816182 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.816279 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.816499 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.816588 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.816811 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.816900 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.817161 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.817255 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.817454 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.817544 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.817758 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.817849 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.818053 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.818139 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.818349 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.818440 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.818651 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.818740 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.818944 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.819040 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.819242 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.819329 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.819561 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.819662 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.819928 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.820025 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.820279 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.820367 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.820589 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.820676 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.820909 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.821005 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.821248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.821339 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.821549 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.821647 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.821866 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.821969 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.822167 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.822250 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.822464 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.822563 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.822760 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.822848 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.823055 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.823141 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.823389 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.823476 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.823688 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.823821 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.824004 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.824092 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.824306 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.824400 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.824624 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.824721 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.824930 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.825027 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.825269 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.825368 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.825582 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.825679 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.825892 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.825979 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.826194 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.826290 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.826503 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.826597 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.826811 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.826905 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.827107 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.827202 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.827407 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.827495 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.827710 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.827799 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.828008 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.828108 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.828308 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.828529 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.828662 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.828852 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.828939 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.829185 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.829291 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.829491 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.829586 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.830036 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.830144 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.830345 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.830433 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.830650 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.830737 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.830955 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.831051 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.831255 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.831343 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.831553 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.831642 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.831854 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.831951 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.832151 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.832239 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.832474 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.832560 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.832771 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.832871 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.833093 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.833211 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.833419 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.833511 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.833727 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.833816 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.834037 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.834124 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.834346 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.834432 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.834659 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.834751 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.834974 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.835076 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.835817 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.835922 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.836217 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.836320 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.836527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.836621 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.836834 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.836934 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.837159 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.837250 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.837474 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.837579 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.837782 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.837884 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.838089 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.838306 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.838394 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.838635 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.838762 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.838945 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.839041 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.839253 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.839341 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.839560 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.839664 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.839874 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.839961 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.840182 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.840336 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.840486 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.840582 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.840795 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.840891 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.841099 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.841243 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.841426 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.841629 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.841751 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.841939 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.842067 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.842267 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.842385 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.842585 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.842717 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.842903 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.843032 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.843212 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.843345 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.843520 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.843654 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.843839 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.843966 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.844139 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.844317 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.844435 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.844628 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.844724 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.844929 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.845062 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.845264 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.845355 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.845574 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.845661 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.845885 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.845981 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.846193 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.846284 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.846501 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.846589 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.846800 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.846894 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.847106 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.847330 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.847425 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.847674 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.847838 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.847986 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.848081 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.848292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.848380 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.848609 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.848705 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.848920 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.849021 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.849240 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.849331 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.849560 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.849657 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.849861 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.849992 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.850162 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.850250 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.850475 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.850671 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.850765 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.851555 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.851725 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.851911 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.852064 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.852243 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.852374 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.852565 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.852681 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.852879 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.852976 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.853216 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.853319 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.853538 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.853628 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.853844 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.853944 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.854145 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.854233 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.854450 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.854538 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.854753 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.854843 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.855054 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.855187 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.855349 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.855437 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.855647 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.855745 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.855943 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.856038 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.856244 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.856348 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.856544 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.856645 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.856839 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.857067 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.857188 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.857436 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.857537 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.857743 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.857830 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.858062 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.858148 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.858379 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.858474 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.858677 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.858766 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.858980 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.859073 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.859278 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.859366 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.859574 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.859663 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.859876 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.859963 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.860179 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.860274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.860482 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.860571 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.860787 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.860876 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.861086 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.861211 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.861416 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.861506 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.861719 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.861854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.862017 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.862253 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.862341 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.862581 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.862676 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.862897 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.862994 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.863204 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.863300 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.863505 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.863600 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.863804 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.863894 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.864110 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.864199 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.864407 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.864494 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.864705 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.864799 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.865004 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.865093 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.865327 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.865440 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.865636 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.865723 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.865933 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.866019 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.866235 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.866329 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.866594 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.866683 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.866910 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.866998 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.867261 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.867369 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.867566 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.867655 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.867864 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.867950 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.868169 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.868266 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.868471 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.868559 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.868770 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.868857 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.869074 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.869191 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.869403 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.869489 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.869720 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.869808 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.870032 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.870167 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.870339 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.870426 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.870650 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.870745 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.870959 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.871049 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.871262 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.871489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.871590 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.871819 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.871908 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.872138 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.872226 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.872444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.872532 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.872765 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.872856 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.873064 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.873199 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.873388 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.873477 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.873689 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.874007 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.874094 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.874313 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.874401 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.874620 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.874709 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.874924 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.875018 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.875229 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.875355 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.875533 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.875624 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.875838 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.875926 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.876142 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.876236 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.876445 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.876547 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.876745 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.876834 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.877047 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.877265 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.877360 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.877450 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.877665 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.877755 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.877968 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.878065 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.878270 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.878366 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.878578 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.878673 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.878883 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.878979 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.879189 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.879277 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.879498 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.879597 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.879804 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.879901 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.880101 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.880189 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.880397 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.880493 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.880700 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.880789 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.880997 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.881085 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.881317 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.881406 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.881615 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.881705 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.881913 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.882002 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.882240 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.882336 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.882536 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.882649 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.882838 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.883126 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.883214 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.883422 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.883512 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.883717 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.883804 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.884012 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.884100 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.884312 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.884409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.884607 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.884695 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.884903 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.884991 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.885223 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.885327 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.885522 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.885640 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.885813 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.885950 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.886136 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.886275 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.886463 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.886609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.886771 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.886934 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.887085 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.887256 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.887393 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.887558 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.887707 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.887859 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.888008 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.888158 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.888322 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.888462 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.888635 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.888774 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.888942 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.889077 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.889303 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.889453 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.889596 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.889687 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.889898 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.889986 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.890203 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.890300 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.890508 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.890605 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.890813 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.890901 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.891116 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.891205 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.891417 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.891505 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.891714 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.891810 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.892010 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.892098 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.892309 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.892399 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.892606 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.892694 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.892902 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.893000 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.893222 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.893315 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.893524 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.893612 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.893820 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.893921 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.894118 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.894207 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.894415 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.894506 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.894712 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.894808 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.895009 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.895097 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.895312 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.895400 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.895616 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.895706 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.895924 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.896013 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.896228 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.896324 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.896532 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.896669 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.896842 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.896932 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.897172 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.897262 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.897492 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.897583 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.898327 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.898423 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.898633 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.898722 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.898937 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.899025 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.899260 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.899385 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.899564 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.899659 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.899870 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.899958 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.900177 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.900266 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.900481 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.900580 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.900783 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.900871 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.901092 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.901213 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.901412 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.901518 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.901652 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 22:01:24.901742 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.902027 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.902345 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.902657 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.902969 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.903279 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.903586 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.903907 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.904214 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.904519 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.904821 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.905148 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.905458 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.905766 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.906073 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.906378 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.906690 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.906998 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.907325 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.907647 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.908273 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.908593 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.908930 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.909262 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.909601 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.909926 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.910234 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.910542 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.910845 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:01:24.911084 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 22:01:25.054677 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO dbcounter [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Registered counter for database nova_api Sep 22 22:01:25.063762 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO dbcounter [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Registered counter for database nova_api Sep 22 22:01:25.075283 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_db.sqlalchemy.engines [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:01:25.082107 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writer thread running {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:01:25.084103 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_db.sqlalchemy.engines [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:01:25.090400 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writer thread running {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:01:25.139870 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.context [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4830448-3328-421e-a52b-a48486017d64(cell1) {{(pid=105645) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 22:01:25.143637 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:01:25.144105 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:01:25.145686 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:01:25.145812 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.context [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4830448-3328-421e-a52b-a48486017d64(cell1) {{(pid=105644) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 22:01:25.146400 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:01:25.146844 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:01:25.149508 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:01:25.150360 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:01:25.150828 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:01:25.151489 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO dbcounter [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Registered counter for database nova_cell0 Sep 22 22:01:25.152386 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:01:25.153123 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:01:25.153607 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:01:25.155557 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO dbcounter [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Registered counter for database nova_cell1 Sep 22 22:01:25.155662 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_concurrency.lockutils [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:01:25.157615 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO dbcounter [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Registered counter for database nova_cell0 Sep 22 22:01:25.161673 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO dbcounter [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Registered counter for database nova_cell1 Sep 22 22:01:25.162874 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_db.sqlalchemy.engines [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:01:25.165707 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_db.sqlalchemy.engines [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:01:25.169036 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_db.sqlalchemy.engines [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:01:25.170504 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writer thread running {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:01:25.171290 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_db.sqlalchemy.engines [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:01:25.175671 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writer thread running {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:01:25.176673 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writer thread running {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:01:25.178737 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writer thread running {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:01:25.316835 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO dbcounter [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Registered counter for database nova_cell0 Sep 22 22:01:25.322145 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO dbcounter [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Registered counter for database nova_cell0 Sep 22 22:01:25.326489 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_db.sqlalchemy.engines [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:01:25.330914 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG oslo_db.sqlalchemy.engines [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:01:25.331595 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writer thread running {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:01:25.335723 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writer thread running {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:01:25.669890 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: WARNING keystonemiddleware.auth_token [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 22:01:25.672928 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: WARNING keystonemiddleware.auth_token [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 22:01:25.677326 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: WARNING keystonemiddleware.auth_token [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 22:01:25.680751 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: WARNING keystonemiddleware.auth_token [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 22:01:26.020111 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: WARNING keystonemiddleware.auth_token [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 22:01:26.023839 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: WARNING keystonemiddleware.auth_token [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 22:01:26.026690 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: WARNING keystonemiddleware.auth_token [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 22:01:26.029804 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: WARNING keystonemiddleware.auth_token [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 22:01:26.031953 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb97ec59c0 pid: 105644 (default app) Sep 22 22:01:26.034049 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:01:26.035050 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb97ec59c0 pid: 105645 (default app) Sep 22 22:01:26.035251 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-207213d4-5f5c-4324-b52f-f1cf9a564d65 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001791 Sep 22 22:01:26.035673 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Thu Sep 22 22:01:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:02:46.966789 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:02:46.968720 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003049 Sep 22 22:02:46.975495 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:02:46 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:02:46.988955 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:SELECT=3 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:46.991041 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_cell1:SELECT=3 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:46.992186 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_cell0:SELECT=3 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:46.993188 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:47.882871 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-2a7f1624-1e6f-45f8-98f7-a9f1e81a42b5 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:02:47.915169 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-2a7f1624-1e6f-45f8-98f7-a9f1e81a42b5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938425 Sep 22 22:02:47.916119 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 22 22:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:02:50.534185 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:02:50.535191 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-c97202d8-7029-4ccf-b462-34768c58d12c None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 22 22:02:50.535759 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:02:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:02:50.983979 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-d3e8da2d-09e3-4f59-8e5b-90d7b5d75e1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:02:51.029974 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-d3e8da2d-09e3-4f59-8e5b-90d7b5d75e1a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488099 Sep 22 22:02:51.030533 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:02:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 22:02:51.248945 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-919460c3-1712-4285-abc6-6a5b3e7e246b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:02:51.255671 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_api:SELECT=3 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:51.257068 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_cell0:SELECT=3 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:51.257429 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_cell1:SELECT=3 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:51.258089 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:02:51.321692 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-919460c3-1712-4285-abc6-6a5b3e7e246b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282139 Sep 22 22:02:51.322277 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 22 22:02:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:02:53.968617 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-d3e8da2d-09e3-4f59-8e5b-90d7b5d75e1a admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:02:53.969640 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-d3e8da2d-09e3-4f59-8e5b-90d7b5d75e1a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 22 22:02:53.970783 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:02:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:02:54.633012 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-87c1c0de-d3de-47bf-a2ba-07443e5584e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M"}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:02:54.674931 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-87c1c0de-d3de-47bf-a2ba-07443e5584e8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.698147 Sep 22 22:02:54.675524 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:02:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:02:54.688010 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-d1788b5e-9b75-4e5f-86c0-f7d092138a52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:02:54.732151 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-d1788b5e-9b75-4e5f-86c0-f7d092138a52 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047753 Sep 22 22:02:54.732994 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 22 22:02:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:02:57.321829 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-87c1c0de-d3de-47bf-a2ba-07443e5584e8 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:02:57.322841 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-87c1c0de-d3de-47bf-a2ba-07443e5584e8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 22 22:02:57.323246 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:02:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:02:57.732002 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-66ed8e02-d501-4ce5-a0a0-bb9ea6f53aa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "swap": 0, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:02:57.753425 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-66ed8e02-d501-4ce5-a0a0-bb9ea6f53aa3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422506 Sep 22 22:02:57.757575 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:02:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:02:57.765668 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-00928c30-5550-47a7-9760-5b2722eb8959 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:02:57.795525 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-00928c30-5550-47a7-9760-5b2722eb8959 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033465 Sep 22 22:02:57.796106 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 22 22:02:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:03:00.416585 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-66ed8e02-d501-4ce5-a0a0-bb9ea6f53aa3 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:00.417620 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-66ed8e02-d501-4ce5-a0a0-bb9ea6f53aa3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 22 22:03:00.418017 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:03:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:00.838121 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-695fa3c2-022c-4324-9f6b-64d62d748d59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:00.858044 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-695fa3c2-022c-4324-9f6b-64d62d748d59 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433944 Sep 22 22:03:00.858931 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:03:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:03:00.875752 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-ccc4306f-bf0f-4841-b0a1-a8b26e4b82fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:00.904813 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-ccc4306f-bf0f-4841-b0a1-a8b26e4b82fb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036216 Sep 22 22:03:00.905473 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 22 22:03:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:03:03.583611 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-695fa3c2-022c-4324-9f6b-64d62d748d59 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:03.584709 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-695fa3c2-022c-4324-9f6b-64d62d748d59 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 22 22:03:03.585178 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:03:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:04.024032 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-fdf27eca-2226-4bff-98d6-4317121b8230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "id": "d4", "name": "ds4G"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:04.043423 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-fdf27eca-2226-4bff-98d6-4317121b8230 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451702 Sep 22 22:03:04.043970 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:03:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:03:04.056059 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-1d5764b2-133c-403f-a5a8-deaef4bf23b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:04.084167 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-1d5764b2-133c-403f-a5a8-deaef4bf23b2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031547 Sep 22 22:03:04.084822 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 22 22:03:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:03:06.744646 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-fdf27eca-2226-4bff-98d6-4317121b8230 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:06.745615 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-fdf27eca-2226-4bff-98d6-4317121b8230 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 22 22:03:06.746011 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:03:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:07.154890 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-85921ce8-a751-4bf0-8b34-c2f1d8095819 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:07.181163 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-85921ce8-a751-4bf0-8b34-c2f1d8095819 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.428065 Sep 22 22:03:07.181681 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 22 22:03:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:03:09.815203 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-fdf27eca-2226-4bff-98d6-4317121b8230 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:09.816238 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-fdf27eca-2226-4bff-98d6-4317121b8230 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 22 22:03:09.816667 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:03:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:10.236894 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-26886417-692d-4ddc-af0d-ebebc1d3201b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:10.256203 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-26886417-692d-4ddc-af0d-ebebc1d3201b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.433336 Sep 22 22:03:10.256726 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:03:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:03:10.269271 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-0bd45c85-94a9-4daa-a70c-bbdc5517d6b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:10.295233 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-0bd45c85-94a9-4daa-a70c-bbdc5517d6b2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030393 Sep 22 22:03:10.295793 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 22 22:03:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:03:12.956600 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-26886417-692d-4ddc-af0d-ebebc1d3201b admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:12.957641 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-26886417-692d-4ddc-af0d-ebebc1d3201b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 22 22:03:12.958042 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:03:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:13.334833 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-6164401a-79d4-4924-af55-e4110ccb38a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:13.354217 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-6164401a-79d4-4924-af55-e4110ccb38a6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.390000 Sep 22 22:03:13.354799 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:03:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:03:13.367803 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-67bc59ff-2850-47d5-be8d-ed714a3e6d6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:13.390680 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-67bc59ff-2850-47d5-be8d-ed714a3e6d6c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026884 Sep 22 22:03:13.391353 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 22 22:03:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:03:16.051608 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-6164401a-79d4-4924-af55-e4110ccb38a6 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:16.053353 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-6164401a-79d4-4924-af55-e4110ccb38a6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 Sep 22 22:03:16.054305 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:03:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:16.486931 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-c651c723-37ec-4c31-b2b9-9fb9fac736da admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:16.510000 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-c651c723-37ec-4c31-b2b9-9fb9fac736da admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449689 Sep 22 22:03:16.510655 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:03:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 22:03:16.523742 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-edf25c51-c60d-45fa-ae74-fcb343a59b74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:16.552229 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-edf25c51-c60d-45fa-ae74-fcb343a59b74 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032456 Sep 22 22:03:16.552939 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 22 22:03:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:03:19.169516 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-c651c723-37ec-4c31-b2b9-9fb9fac736da admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:19.171455 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-c651c723-37ec-4c31-b2b9-9fb9fac736da admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002393 Sep 22 22:03:19.172032 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:03:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:19.623035 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-152dba18-d9e3-4d70-a301-7f4a90874c5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "swap": 0, "name": "m1.large"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:19.629519 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:19.645695 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-152dba18-d9e3-4d70-a301-7f4a90874c5e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.467467 Sep 22 22:03:19.649153 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:03:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:03:19.658593 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-cffdce24-8ca3-48a7-88ed-f2d58a614471 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:19.684979 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-cffdce24-8ca3-48a7-88ed-f2d58a614471 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030053 Sep 22 22:03:19.693205 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 22 22:03:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:03:22.387406 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-152dba18-d9e3-4d70-a301-7f4a90874c5e admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:22.388624 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-152dba18-d9e3-4d70-a301-7f4a90874c5e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Sep 22 22:03:22.389137 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:03:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:22.869733 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-9c9892aa-56d6-4da6-87fa-3f0bced8e79b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:22.877499 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:22.893534 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-9c9892aa-56d6-4da6-87fa-3f0bced8e79b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496861 Sep 22 22:03:22.894256 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 22 22:03:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:03:22.906452 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-48fefff3-fc81-48b3-86eb-f26c3bb2331c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:22.932026 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-48fefff3-fc81-48b3-86eb-f26c3bb2331c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029528 Sep 22 22:03:22.932604 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 22 22:03:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:03:40.160601 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-9c9892aa-56d6-4da6-87fa-3f0bced8e79b admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:40.161668 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-9c9892aa-56d6-4da6-87fa-3f0bced8e79b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 22 22:03:40.162066 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:03:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:40.172994 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:03:40.558955 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-1fcea5cd-172a-4e04-90fa-00c03dffed93 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:40.577867 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-1fcea5cd-172a-4e04-90fa-00c03dffed93 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409628 Sep 22 22:03:40.578335 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 22 22:03:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:03:41.912749 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-9c9892aa-56d6-4da6-87fa-3f0bced8e79b admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:41.913794 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-9c9892aa-56d6-4da6-87fa-3f0bced8e79b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 22 22:03:41.914354 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:03:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:42.438506 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-e97bf688-77a7-4948-a348-8b1bbf5f9430 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:42.444180 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.wsgi [None req-e97bf688-77a7-4948-a348-8b1bbf5f9430 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-e97bf688-77a7-4948-a348-8b1bbf5f9430 admin admin] Request method failure captured: Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Accept: application/json Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Accept-Encoding: gzip, deflate Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Connection: keep-alive Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Content-Length: 0 Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Host: 10.222.0.25 Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Openstack-Api-Version: compute 2.92 Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Openstack-System-Scope: None Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: User-Agent: python-novaclient Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Auth-Token: gAAAAABjLNu94743Z_g99S6bD6-LgkencBzvNE3RZVdJHXZ9PD3CPHnIe5T8Ky9qxXAFArx8OZwdItq5GqEqlNp-TGs1iDOzH7Q1yUQsW-IBRqRzvkRzSL5wB8M3tBlNlMWulvIKnBUK6UrLBu6U3wAzqhiYOdvGXLFPhWyce6MEYnZv9Llm0y4 Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Domain-Id: None Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Domain-Name: None Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Identity-Status: Confirmed Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Is-Admin-Project: True Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Domain-Id: default Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Domain-Name: Default Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Name: admin Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Role: member,reader,admin Sep 22 22:03:42.447451 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Roles: member,reader,admin Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f680186a14a640efb3f020f909ac5fa9", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Tenant: admin Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Tenant-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Tenant-Name: admin Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User: admin Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Domain-Id: default Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Domain-Name: Default Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Id: 9a8dd819f6d742ceba5a020c855827f8 Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Name: admin Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: method: > Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: exception: Flavor 42 could not be found. Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: action_args: {'id': '42'} Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:03:42.449318 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:42.450409 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.452410 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-e97bf688-77a7-4948-a348-8b1bbf5f9430 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:03:42.453698 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-e97bf688-77a7-4948-a348-8b1bbf5f9430 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397213 Sep 22 22:03:42.453698 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 22 22:03:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:42.459437 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-a92fe191-633d-4625-acf4-eb482dd3d993 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:42.481526 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-a92fe191-633d-4625-acf4-eb482dd3d993 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025545 Sep 22 22:03:42.482175 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 22 22:03:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:03:42.492771 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-03d4b8fe-f289-45dc-9cad-b125e39cffbc admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:42.515570 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-03d4b8fe-f289-45dc-9cad-b125e39cffbc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027307 Sep 22 22:03:42.516097 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 22 22:03:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:03:42.525421 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-33e0e9e0-dde0-471f-874b-e95841293717 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:42.531034 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.wsgi [None req-33e0e9e0-dde0-471f-874b-e95841293717 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-33e0e9e0-dde0-471f-874b-e95841293717 admin admin] Request method failure captured: Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Accept: application/json Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Accept-Encoding: gzip, deflate Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Connection: keep-alive Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Content-Length: 0 Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Host: 10.222.0.25 Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Openstack-Api-Version: compute 2.92 Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Openstack-System-Scope: None Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: User-Agent: python-novaclient Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Auth-Token: gAAAAABjLNu94743Z_g99S6bD6-LgkencBzvNE3RZVdJHXZ9PD3CPHnIe5T8Ky9qxXAFArx8OZwdItq5GqEqlNp-TGs1iDOzH7Q1yUQsW-IBRqRzvkRzSL5wB8M3tBlNlMWulvIKnBUK6UrLBu6U3wAzqhiYOdvGXLFPhWyce6MEYnZv9Llm0y4 Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Domain-Id: None Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Domain-Name: None Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Identity-Status: Confirmed Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Is-Admin-Project: True Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Domain-Id: default Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Domain-Name: Default Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Name: admin Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Role: member,reader,admin Sep 22 22:03:42.534444 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Roles: member,reader,admin Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f680186a14a640efb3f020f909ac5fa9", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Tenant: admin Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Tenant-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Tenant-Name: admin Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User: admin Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Domain-Id: default Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Domain-Name: Default Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Id: 9a8dd819f6d742ceba5a020c855827f8 Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Name: admin Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: method: > Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: exception: Flavor 42 could not be found. Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: action_args: {'id': '42'} Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:03:42.535973 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:42.536974 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:42.538280 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-33e0e9e0-dde0-471f-874b-e95841293717 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:03:42.539529 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-33e0e9e0-dde0-471f-874b-e95841293717 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014017 Sep 22 22:03:42.539529 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 22 22:03:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 22 22:03:43.763752 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-03d4b8fe-f289-45dc-9cad-b125e39cffbc admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:43.764752 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-03d4b8fe-f289-45dc-9cad-b125e39cffbc admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 22 22:03:43.765172 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:44.396666 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-9d13f900-b6a6-473e-971b-00fcb55178f2 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:44.401625 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.wsgi [None req-9d13f900-b6a6-473e-971b-00fcb55178f2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-9d13f900-b6a6-473e-971b-00fcb55178f2 admin admin] Request method failure captured: Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Accept: application/json Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Accept-Encoding: gzip, deflate Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Connection: keep-alive Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Content-Length: 0 Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Host: 10.222.0.25 Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Openstack-Api-Version: compute 2.92 Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Openstack-System-Scope: None Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: User-Agent: python-novaclient Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Auth-Token: gAAAAABjLNu_UwLLKbp9mzaeMMH5R9vuDk0q124jcJnC-aIwOG5sBUkmfgCTuVJF9nvH2fY8pQrHkn8SXLR9Mgk0nsaqnBdAWP6Dm6vkYYGSKhCnZlNQoTXclShObc-MB6ShyurbeVizDgPwbeIqechLjMGXTpTZBG64BWfY0nQ3elF6dS39GBQ Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Domain-Id: None Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Domain-Name: None Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Identity-Status: Confirmed Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Is-Admin-Project: True Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Domain-Id: default Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Domain-Name: Default Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Name: admin Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Role: member,reader,admin Sep 22 22:03:44.403103 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Roles: member,reader,admin Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f680186a14a640efb3f020f909ac5fa9", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Tenant: admin Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Tenant-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Tenant-Name: admin Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User: admin Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Domain-Id: default Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Domain-Name: Default Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Id: 9a8dd819f6d742ceba5a020c855827f8 Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Name: admin Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: method: > Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: exception: Flavor 84 could not be found. Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: action_args: {'id': '84'} Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:03:44.405217 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:44.406222 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.407527 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-9d13f900-b6a6-473e-971b-00fcb55178f2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:03:44.408752 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-9d13f900-b6a6-473e-971b-00fcb55178f2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.505131 Sep 22 22:03:44.408752 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 22 22:03:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 506 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:44.414762 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-80f626ee-4491-4719-9d3e-e9e499b81eae admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:44.429386 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-80f626ee-4491-4719-9d3e-e9e499b81eae admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018154 Sep 22 22:03:44.429904 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 22 22:03:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:03:44.439341 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-6b0569ce-5241-4db0-b129-cc15414ebe8a admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:44.455098 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-6b0569ce-5241-4db0-b129-cc15414ebe8a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019349 Sep 22 22:03:44.455616 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 22 22:03:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:03:44.464584 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-557cdd5a-39c5-4ea2-9a6f-36c6edfb5f5e admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:44.470180 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.wsgi [None req-557cdd5a-39c5-4ea2-9a6f-36c6edfb5f5e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-557cdd5a-39c5-4ea2-9a6f-36c6edfb5f5e admin admin] Request method failure captured: Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Accept: application/json Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Accept-Encoding: gzip, deflate Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Connection: keep-alive Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Content-Length: 0 Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Host: 10.222.0.25 Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Openstack-Api-Version: compute 2.92 Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Openstack-System-Scope: None Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: User-Agent: python-novaclient Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Auth-Token: gAAAAABjLNu_UwLLKbp9mzaeMMH5R9vuDk0q124jcJnC-aIwOG5sBUkmfgCTuVJF9nvH2fY8pQrHkn8SXLR9Mgk0nsaqnBdAWP6Dm6vkYYGSKhCnZlNQoTXclShObc-MB6ShyurbeVizDgPwbeIqechLjMGXTpTZBG64BWfY0nQ3elF6dS39GBQ Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Domain-Id: None Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Domain-Name: None Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Identity-Status: Confirmed Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Is-Admin-Project: True Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Domain-Id: default Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Domain-Name: Default Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Name: admin Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Role: member,reader,admin Sep 22 22:03:44.471701 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Roles: member,reader,admin Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f680186a14a640efb3f020f909ac5fa9", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Tenant: admin Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Tenant-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Tenant-Name: admin Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User: admin Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Domain-Id: default Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Domain-Name: Default Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Id: 9a8dd819f6d742ceba5a020c855827f8 Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Name: admin Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: method: > Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: exception: Flavor 84 could not be found. Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: action_args: {'id': '84'} Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:03:44.473446 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:44.474292 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:44.475609 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-557cdd5a-39c5-4ea2-9a6f-36c6edfb5f5e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:03:44.476896 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-557cdd5a-39c5-4ea2-9a6f-36c6edfb5f5e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011937 Sep 22 22:03:44.476896 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 22 22:03:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:45.690372 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-6b0569ce-5241-4db0-b129-cc15414ebe8a admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:45.691392 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-6b0569ce-5241-4db0-b129-cc15414ebe8a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 22 22:03:45.691790 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:03:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:46.355781 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-8a97d20f-73fe-434e-b148-f793997f88eb admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:46.362285 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.wsgi [None req-8a97d20f-73fe-434e-b148-f793997f88eb admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-8a97d20f-73fe-434e-b148-f793997f88eb admin admin] Request method failure captured: Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Accept: application/json Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Accept-Encoding: gzip, deflate Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Connection: keep-alive Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Content-Length: 0 Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Host: 10.222.0.25 Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Openstack-Api-Version: compute 2.92 Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Openstack-System-Scope: None Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: User-Agent: python-novaclient Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Auth-Token: gAAAAABjLNvB6AdmV2rlgcotzjbQjrDDRAmIJk9yBCufdsLkD7PpNIz9p7ZJqHOlo3qUZOXy_3LlKujNAt36wPLpxMs0CiOXmYn4QpFtbEbxxYBRHXnPGGZxYvSfquzPKIoXPEwciZ95-2Rs-6ljxGplU0TGXMXtifhrY1z34u7DPZv4XaRMSpw Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Domain-Id: None Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Domain-Name: None Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Identity-Status: Confirmed Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Is-Admin-Project: True Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Domain-Id: default Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Domain-Name: Default Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Project-Name: admin Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Role: member,reader,admin Sep 22 22:03:46.363807 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Roles: member,reader,admin Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f680186a14a640efb3f020f909ac5fa9", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Tenant: admin Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Tenant-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-Tenant-Name: admin Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User: admin Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Domain-Id: default Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Domain-Name: Default Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Id: 9a8dd819f6d742ceba5a020c855827f8 Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: X-User-Name: admin Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: method: > Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: exception: Flavor 451 could not be found. Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: action_args: {'id': '451'} Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:03:46.365248 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:46.367274 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.368489 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-8a97d20f-73fe-434e-b148-f793997f88eb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:03:46.369537 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-8a97d20f-73fe-434e-b148-f793997f88eb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.536931 Sep 22 22:03:46.369537 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 22 22:03:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:46.375493 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-1a8824c2-9fd8-405e-bc7a-7702f08635ee admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:46.393603 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-1a8824c2-9fd8-405e-bc7a-7702f08635ee admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021715 Sep 22 22:03:46.394519 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 22 22:03:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:03:46.405019 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:46.423214 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022051 Sep 22 22:03:46.423813 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 22 22:03:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:03:46.434326 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-c8edbaee-4e1a-4638-959f-d0b6dc656b4b admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:46.442783 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.wsgi [None req-c8edbaee-4e1a-4638-959f-d0b6dc656b4b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-c8edbaee-4e1a-4638-959f-d0b6dc656b4b admin admin] Request method failure captured: Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Accept: application/json Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Accept-Encoding: gzip, deflate Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Connection: keep-alive Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Content-Length: 0 Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Host: 10.222.0.25 Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Openstack-Api-Version: compute 2.92 Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Openstack-System-Scope: None Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: User-Agent: python-novaclient Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Auth-Token: gAAAAABjLNvB6AdmV2rlgcotzjbQjrDDRAmIJk9yBCufdsLkD7PpNIz9p7ZJqHOlo3qUZOXy_3LlKujNAt36wPLpxMs0CiOXmYn4QpFtbEbxxYBRHXnPGGZxYvSfquzPKIoXPEwciZ95-2Rs-6ljxGplU0TGXMXtifhrY1z34u7DPZv4XaRMSpw Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Domain-Id: None Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Domain-Name: None Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Identity-Status: Confirmed Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Is-Admin-Project: True Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Domain-Id: default Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Domain-Name: Default Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Project-Name: admin Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Role: member,reader,admin Sep 22 22:03:46.446670 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Roles: member,reader,admin Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f680186a14a640efb3f020f909ac5fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f680186a14a640efb3f020f909ac5fa9", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Tenant: admin Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Tenant-Id: f680186a14a640efb3f020f909ac5fa9 Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-Tenant-Name: admin Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User: admin Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Domain-Id: default Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Domain-Name: Default Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Id: 9a8dd819f6d742ceba5a020c855827f8 Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: X-User-Name: admin Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: method: > Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: exception: Flavor 451 could not be found. Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: action_args: {'id': '451'} Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:03:46.451500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:46.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: ERROR nova.api.openstack.wsgi Sep 22 22:03:46.453854 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-c8edbaee-4e1a-4638-959f-d0b6dc656b4b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:03:46.455114 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-c8edbaee-4e1a-4638-959f-d0b6dc656b4b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.017908 Sep 22 22:03:46.455114 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 22 22:03:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 22:03:47.781222 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:47.782230 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 22 22:03:47.782628 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:03:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:48.308157 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-ad27cfa8-ac74-40e4-ab12-a6d187a181bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:48.328480 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-ad27cfa8-ac74-40e4-ab12-a6d187a181bf admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406569 Sep 22 22:03:48.329011 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 22 22:03:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:03:49.561017 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:49.562056 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 22 22:03:49.562474 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:03:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:50.084887 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-c607240a-d4ef-40a4-9dbd-d8779de4d43e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:50.104054 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-c607240a-d4ef-40a4-9dbd-d8779de4d43e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.406201 Sep 22 22:03:50.104640 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 22 22:03:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 22:03:51.321927 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:51.322939 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 22 22:03:51.323354 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:03:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:51.846709 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-30608589-72d1-485c-bd00-c4b6b4ecb3a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:51.865759 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-30608589-72d1-485c-bd00-c4b6b4ecb3a8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404979 Sep 22 22:03:51.866297 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 22 22:03:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:03:53.080772 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:53.081828 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 22 22:03:53.082212 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:03:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:53.599691 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-23062f90-303f-404d-818c-54d209fc7376 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:03:53.617529 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-23062f90-303f-404d-818c-54d209fc7376 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396422 Sep 22 22:03:53.618073 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 22 22:03:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:03:54.828081 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:54.829137 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 22 22:03:54.829540 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:03:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:03:55.371143 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-ffb4fc48-4ac9-40e7-a18c-404a4332d8c4 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:03:55.391375 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-ffb4fc48-4ac9-40e7-a18c-404a4332d8c4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400353 Sep 22 22:03:55.391911 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Thu Sep 22 22:03:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:04:52.253570 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:04:52.254580 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-96e46c91-e85c-4e93-993f-66e70d38cf91 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 22 22:04:52.254978 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 22 22:04:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:04:52.266147 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:52.642021 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-bbf01b1a-ba03-4dfe-aeaf-1a29ea625c3d admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:04:52.662489 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-bbf01b1a-ba03-4dfe-aeaf-1a29ea625c3d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400724 Sep 22 22:04:52.663033 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 22 22:04:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:04:52.688279 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-50709434-31db-4d6a-b80e-054b5173fda9 admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:04:52.691665 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:SELECT=14 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:04:52.697617 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-50709434-31db-4d6a-b80e-054b5173fda9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013498 Sep 22 22:04:52.698148 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Sep 22 22:04:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:04:52.709532 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-55e11acb-8a30-4614-883f-2f4ee9df0b15 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:04:52.716986 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-55e11acb-8a30-4614-883f-2f4ee9df0b15 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010936 Sep 22 22:04:52.717548 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Sep 22 22:04:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:04:52.729123 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:04:52.736267 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011107 Sep 22 22:04:52.736773 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Sep 22 22:04:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:04:52.749796 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-40dd4fdb-6a40-487e-b8d1-2ad320fa9183 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:04:52.757499 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-40dd4fdb-6a40-487e-b8d1-2ad320fa9183 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011485 Sep 22 22:04:52.758379 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Sep 22 22:04:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:08:10.583089 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:08:10.584101 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 22 22:08:10.584492 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:08:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:08:10.729911 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_api:SELECT=6 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:08:10.887092 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-bbaf9568-3378-4aaa-9429-5fc08d2bb85c admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:08:10.892297 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-bbaf9568-3378-4aaa-9429-5fc08d2bb85c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:08:10.892858 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-bbaf9568-3378-4aaa-9429-5fc08d2bb85c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:08:10.893309 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-bbaf9568-3378-4aaa-9429-5fc08d2bb85c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:08:10.894017 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-bbaf9568-3378-4aaa-9429-5fc08d2bb85c admin admin] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:08:10.894459 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-bbaf9568-3378-4aaa-9429-5fc08d2bb85c admin admin] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:08:10.894871 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-bbaf9568-3378-4aaa-9429-5fc08d2bb85c admin admin] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:08:10.926025 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-bbaf9568-3378-4aaa-9429-5fc08d2bb85c admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197340 Sep 22 22:08:10.926570 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 22 22:08:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:08:12.014455 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:08:12.015467 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 22 22:08:12.015863 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:08:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:08:12.204837 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-4fd51802-71cc-443c-8f29-4106ad258175 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:08:12.208189 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-4fd51802-71cc-443c-8f29-4106ad258175 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:08:12.208660 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-4fd51802-71cc-443c-8f29-4106ad258175 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:08:12.209089 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-4fd51802-71cc-443c-8f29-4106ad258175 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:08:12.209843 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-4fd51802-71cc-443c-8f29-4106ad258175 admin admin] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:08:12.210284 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-4fd51802-71cc-443c-8f29-4106ad258175 admin admin] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:08:12.210699 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-4fd51802-71cc-443c-8f29-4106ad258175 admin admin] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:08:12.230025 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-4fd51802-71cc-443c-8f29-4106ad258175 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.074689 Sep 22 22:08:12.230564 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 22 22:08:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 22:08:23.720967 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:08:23.722002 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 22 22:08:23.722402 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:08:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:08:23.866761 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_cell0:SELECT=4 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:08:23.867476 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_cell1:SELECT=4 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:08:23.868101 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG dbcounter [-] [105645] Writing DB stats nova_api:SELECT=8 {{(pid=105645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:08:23.914708 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-f8ea8ed5-ef0f-431e-af7a-bb176cd2fd4e admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:08:23.918059 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-f8ea8ed5-ef0f-431e-af7a-bb176cd2fd4e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:08:23.918526 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-f8ea8ed5-ef0f-431e-af7a-bb176cd2fd4e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:08:23.918948 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-f8ea8ed5-ef0f-431e-af7a-bb176cd2fd4e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:08:23.919693 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-f8ea8ed5-ef0f-431e-af7a-bb176cd2fd4e admin admin] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:08:23.920163 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-f8ea8ed5-ef0f-431e-af7a-bb176cd2fd4e admin admin] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:08:23.920574 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-f8ea8ed5-ef0f-431e-af7a-bb176cd2fd4e admin admin] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:08:23.946384 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-f8ea8ed5-ef0f-431e-af7a-bb176cd2fd4e admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.083955 Sep 22 22:08:23.946922 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 37/74] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 22 22:08:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:08:25.031171 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG nova.api.openstack.wsgi [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] Calling method '>' {{(pid=105644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:08:25.032921 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: INFO nova.api.openstack.requestlog [None req-e859e1d5-8521-482c-97ec-f0fe17d7739b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 22 22:08:25.033475 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: [pid: 105644|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 22 22:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:08:25.225626 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG nova.api.openstack.wsgi [None req-1393e4c8-e6b4-472b-b3aa-07859eb13bf4 admin admin] Calling method '>' {{(pid=105645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:08:25.228929 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-1393e4c8-e6b4-472b-b3aa-07859eb13bf4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:08:25.229436 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-1393e4c8-e6b4-472b-b3aa-07859eb13bf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:08:25.229864 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-1393e4c8-e6b4-472b-b3aa-07859eb13bf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:08:25.230565 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-1393e4c8-e6b4-472b-b3aa-07859eb13bf4 admin admin] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:08:25.231007 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-1393e4c8-e6b4-472b-b3aa-07859eb13bf4 admin admin] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:08:25.231419 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: DEBUG oslo_concurrency.lockutils [None req-1393e4c8-e6b4-472b-b3aa-07859eb13bf4 admin admin] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:08:25.252986 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: INFO nova.api.openstack.requestlog [None req-1393e4c8-e6b4-472b-b3aa-07859eb13bf4 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079030 Sep 22 22:08:25.253556 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: [pid: 105645|app: 0|req: 38/76] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 22 22:08:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:09:25.969954 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: Thu Sep 22 22:09:25 2022 - graceful shutdown triggered... Sep 22 22:09:25.970735 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: Gracefully killing worker 1 (pid: 105644)... Sep 22 22:09:25.971140 dv-cinder-849143-6-iscsi devstack@n-api.service[105645]: Gracefully killing worker 2 (pid: 105645)... Sep 22 22:09:25.971812 dv-cinder-849143-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 22 22:09:26.102929 dv-cinder-849143-6-iscsi devstack@n-api.service[105644]: DEBUG dbcounter [-] [105644] Writing DB stats nova_api:SELECT=4 {{(pid=105644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:09:26.970477 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: worker 1 buried after 1 seconds Sep 22 22:09:26.971039 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: worker 2 buried after 1 seconds Sep 22 22:09:26.971039 dv-cinder-849143-6-iscsi devstack@n-api.service[105643]: goodbye to uWSGI. Sep 22 22:09:26.972052 dv-cinder-849143-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 22 22:09:26.972622 dv-cinder-849143-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 22 22:09:26.975513 dv-cinder-849143-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 22:09:26.986442 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 22:09:26 2022] *** Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: nodename: dv-cinder-849143-6-iscsi Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: machine: x86_64 Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: clock source: unix Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: pcre jit disabled Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: detected number of CPU cores: 4 Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: current working directory: / Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: detected binary path: /usr/bin/uwsgi-core Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: your processes number limit is 47680 Sep 22 22:09:26.988474 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: your memory page size is 4096 bytes Sep 22 22:09:26.989404 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: detected max file descriptor number: 2048 Sep 22 22:09:26.989404 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: lock engine: pthread robust mutexes Sep 22 22:09:26.989404 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: thunder lock: enabled Sep 22 22:09:26.989404 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 22:09:26.989404 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 22:09:27.029438 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: Python main interpreter initialized at 0x55cb67c2c9c0 Sep 22 22:09:27.029438 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: python threads support enabled Sep 22 22:09:27.029438 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: your server socket listen backlog is limited to 100 connections Sep 22 22:09:27.029438 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: your mercy for graceful operations on workers is 90 seconds Sep 22 22:09:27.029886 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 22:09:27.029886 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: *** Operational MODE: preforking *** Sep 22 22:09:27.030153 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: *** uWSGI is running in multiple interpreter mode *** Sep 22 22:09:27.030153 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: spawned uWSGI master process (pid: 120647) Sep 22 22:09:27.030356 dv-cinder-849143-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 22:09:27.030947 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: spawned uWSGI worker 1 (pid: 120662, cores: 1) Sep 22 22:09:27.033137 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: spawned uWSGI worker 2 (pid: 120663, cores: 1) Sep 22 22:09:27.033137 dv-cinder-849143-6-iscsi devstack@n-api.service[120647]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 22:09:27.693716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 22:09:27.696280 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 22:09:28.853837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 22:09:28.853837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: from cryptography.utils import int_from_bytes Sep 22 22:09:28.854575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 22:09:28.854575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: from cryptography.utils import int_from_bytes Sep 22 22:09:28.857668 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 22:09:28.857668 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: from cryptography.utils import int_from_bytes Sep 22 22:09:28.858115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 22:09:28.858115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: from cryptography.utils import int_from_bytes Sep 22 22:09:31.299057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 22:09:31.299658 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 22:09:31.299968 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 22:09:31.300697 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 22:09:31.300697 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 22:09:31.300893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.301178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.301699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.302181 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.302676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.303150 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.303636 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.304122 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.304620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.305046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.305543 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.306194 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-6-iscsi {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.306682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.307163 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.307634 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.308103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.308559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.309043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.309787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.310579 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.313298 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.314045 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.314782 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.315561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.316268 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.316991 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.317739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.318231 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.318714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.319194 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.319774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-6-iscsi {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.320249 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.320724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.321227 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.321813 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.322295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.322768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.323248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.323730 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.324200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.324687 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.324909 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 22:09:31.325382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 22:09:31.325716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 22:09:31.325946 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.326065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 22:09:31.326327 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 22:09:31.326693 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.326805 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.327028 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.327353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.327558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.327682 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.328047 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.328857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.329155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.329281 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.329518 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.329851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.330040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.330152 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.330416 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.330753 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.330872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-6-iscsi {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.331191 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.331474 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.331600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.331802 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.332126 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.332366 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.332485 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.332744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.333053 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.333249 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.333583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.333834 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.333942 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.334194 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.334506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.334690 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.334842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.335163 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.335474 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.335588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.335794 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.336105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.336351 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.336467 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.336727 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.337075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.337224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-6-iscsi {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.337455 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.337774 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.337906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.338087 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.338441 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.338562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.338808 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.339119 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.339310 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.339443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.339771 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.340082 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.340195 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.340411 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.340732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.340918 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.341034 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.341387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.341691 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.341838 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.341999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.342312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.342604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.342721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.342924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.343231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.343454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.343636 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.343807 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.344127 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.344406 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.344515 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.344838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.345094 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.345295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.345398 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.345678 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.346002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.346134 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.346312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.346625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.346888 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.347003 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.347232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.347540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.347828 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.347942 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.348141 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.348454 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.348692 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.348799 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.349079 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.349434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.349660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.349761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.350051 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.350162 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.350452 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.350560 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.350706 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.350899 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.350996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.351171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.351333 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.351557 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.351664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.351951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.352046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.352274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.352435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.353040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.353040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.353352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.353439 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.353521 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.353592 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.353818 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.353929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.354155 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.354262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.354653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.354763 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.354846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.355010 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.355111 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.355300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.355456 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.355675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.355932 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.356039 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.356256 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.356358 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.356519 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.356622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.356869 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.356965 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.357204 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.357380 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.357537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.357693 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.357858 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.358008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.358150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.358293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.358442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.358601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.358749 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.358931 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.359088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.359323 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.359477 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.359764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.359923 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.360264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.360424 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.360567 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.360707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.360863 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.361006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.361206 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.361370 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.361521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.361677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.361831 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.361981 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.362129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.362291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.362459 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.362609 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.362772 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.362934 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.363091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.363300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.363469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.363675 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.363833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.363976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.364125 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.364298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.364454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.364614 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.364871 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.365028 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.365221 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.365368 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.365510 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.365665 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.365814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.365963 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.366107 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.366255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.366405 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.366621 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.366780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.366935 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.367085 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.367235 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.367387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.367595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.367889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.368019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.368197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.368318 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.368542 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.368643 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.368859 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.368976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.369223 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.369337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.369575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.369679 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.369962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.370056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.370277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.370440 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.370599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.370743 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.370894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.371012 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.371242 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.371344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.371580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.371680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.371911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.372055 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.372232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.372337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.372534 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.372625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.372855 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.372947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.373225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.373333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.373537 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.373627 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.373846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.373948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.374152 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.374252 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.374470 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 22:09:31.374568 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.374787 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.375495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.375645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.375781 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.376016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.376141 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.376267 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.376364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.376603 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.376700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.376924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.377027 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.377271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.377384 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.377595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.377693 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.377911 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.378022 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.378235 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.378338 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.378547 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.378653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.378861 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.378968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.379174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.379277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.379498 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.379602 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.379819 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.379918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.380160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.380296 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.380488 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.380592 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.380816 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.380920 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.381175 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.381305 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.381467 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.381621 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.381782 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.381945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.382128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.382278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.382440 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.382603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.382755 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.382916 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.383081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.383258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.383399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.383589 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.383739 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.383902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.384046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.384228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.384365 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.384552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.384687 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.384864 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.384999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.385199 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.385306 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.385530 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.385678 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.385860 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.385960 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.386195 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.386335 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.386658 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.386784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.386986 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.387107 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.387301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.387422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.387622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.387748 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.387937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.388066 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.388248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.388366 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.388561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.388686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.388870 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.389004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.389202 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.389322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.389557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.389717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.389918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.390061 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.390265 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.391046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.391179 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.391293 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.391617 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.391783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.391936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.392087 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.392238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.392387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.392531 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.392686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.392859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.393004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.393181 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.393338 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.393443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.393635 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.393755 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.393947 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.394066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.394258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.394396 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.394570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.394709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.394880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.395019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.395203 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.395346 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.395547 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.395693 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.395846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.395941 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.396183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.396284 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.396498 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.396598 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.396812 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.396911 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.397173 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.398158 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.398296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.398410 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.398520 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.398631 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.398734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.398822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.398906 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.398989 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.399072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.399155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.399155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.399376 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.399468 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.399561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.399688 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.399823 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.400015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.400146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.400467 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.400580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.400775 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.400892 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.401090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.401251 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.401419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.401515 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.401728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.401832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.402036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.402132 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.402347 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.402449 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.402653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.402756 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.402960 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.403056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.403272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.403436 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.403581 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.403735 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.403883 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.404024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.404185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.404322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.404496 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.404645 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.404792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.404943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.405090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.405209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.405412 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.405516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.405757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.405849 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.406091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.406258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.406530 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.406626 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.406712 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.406840 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.407037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.407176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.407382 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.407506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.407691 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.407823 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.407998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.408144 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.408304 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.408465 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.408607 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.408779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.408928 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.409094 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.409265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.409438 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.409575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.409764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.409899 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.410083 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.410218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.410423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.410598 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.410711 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.410932 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.411046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.411276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.411381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.411618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.411769 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.411921 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.412070 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.412244 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.412399 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.412548 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.412695 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.412849 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.412992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.413165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.413260 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.413480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.413576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.413798 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.413953 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.414106 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.414246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.414414 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.414562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.414716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.414865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.415031 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.415184 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.415324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.415462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.415651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.415792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.415963 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.416097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.416285 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.416429 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.416577 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.416711 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.416891 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.417033 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.417236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.417344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.417561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.417660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.417867 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.417959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.418186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.418291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.418523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.418615 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.418857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.418959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.419165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.419268 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.419477 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.419574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.419786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.419932 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.420097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.420211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.420410 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.420571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.420721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.420838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.421025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.421143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.421357 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.421465 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.421688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.421878 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.422095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.422203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.422417 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.422519 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.422725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.422827 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.423042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.423144 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.423368 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.423462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.423682 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.423802 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.423990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.424093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.424296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.424400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.424607 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.424711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.424917 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.425009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.425252 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.425365 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.425563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.425676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.425940 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.426048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.426261 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.426369 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.426480 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.426588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.426794 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.426897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.427105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.427205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.427413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.427518 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.427720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.427834 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.428027 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.428129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.428333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.428427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.428636 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.428731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.428939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.429041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.429289 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.429393 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.429612 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.429708 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.429922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.430021 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.430239 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.430338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.430564 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.430654 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.430854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.430947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.431155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.431263 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.431476 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.431578 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.431785 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.431886 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.432088 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.432181 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.432394 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.432486 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.432697 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.432803 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.433006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.433099 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.433363 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.433463 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.433674 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.433860 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.434017 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.434178 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.434613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.434765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.434914 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.435062 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.435209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.435355 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.435502 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.435660 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.435812 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.436038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.436180 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.436334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.436462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.436644 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.436813 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.436951 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.437090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.437802 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.437912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.438189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.438389 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.438529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.438710 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.438867 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.439038 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.439184 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.439353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.439496 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.439668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.439811 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.439980 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.440121 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.440287 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.440430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.440626 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.440822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.440933 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.441050 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.441385 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.441517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.441697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.441851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.442012 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.442166 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.442320 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.442524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.442638 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.442878 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.442982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.443200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.443310 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.443520 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.443613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.443826 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.443929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.444141 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.444260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.444450 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.444625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.444772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.444923 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.445074 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.445202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.445394 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.445495 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.445709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.445808 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.446016 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.446107 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.446330 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.446430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.446638 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.446746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.446948 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.447041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.447254 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.447355 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.447560 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.447662 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.447866 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.447966 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.448170 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.448276 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.448482 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.448586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.448786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.448877 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.449123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.449215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.449421 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.449523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.449735 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.449837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.450041 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.450138 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.450345 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.450445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.450650 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.450749 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.450955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.451059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.451263 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.451365 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.451575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.451667 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.451882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.451974 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.452192 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.452286 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.452602 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.452820 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.452998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.453717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.453812 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.454030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.454130 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.454339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.454432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.454653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.454746 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.454966 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.455058 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.455273 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.455375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.455587 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.455680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.455893 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.455987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.456209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.456308 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.456515 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.456612 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.456822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.456915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.457141 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.457250 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.457449 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.457539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.457758 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.457857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.458062 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.458204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.458390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.458491 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.458712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.458811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.459020 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.459114 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.459327 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.459427 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.459640 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.459732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.459947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.460043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.460253 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.460343 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.460561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.460658 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.460864 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.460977 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.461219 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.461336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.461527 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.461628 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.461827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.461918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.462130 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.462221 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.462434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.462538 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.462740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.462833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.463042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.463140 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.463346 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.463449 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.463652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.463752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.463955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.464091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.464260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.464362 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.464565 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.464655 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.464867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.464964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.465191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.465300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.465503 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.465595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.465808 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.465911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.466115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.466209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.466427 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.466523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.466734 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.466863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.467037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.467172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.467342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.467435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.467645 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.467744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.467951 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.468043 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.468254 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.468389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.468588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.468763 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.469010 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.469179 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.469347 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.469460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.469656 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.469759 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.469969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.470072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.470277 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.470368 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.470582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.470681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.470886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.470976 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.471203 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.471337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.471510 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.471664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.471824 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.471922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.472144 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.472234 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.472469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.472570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.472783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.472882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.473089 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.473220 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.473422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.473524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.473732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.473829 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.474041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.474176 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.474344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.474441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.474655 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.474754 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.474963 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.475061 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.475275 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.475376 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.475580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.475673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.475887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.475985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.476198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.476298 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.476508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.476606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.476819 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.476920 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.477151 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.477302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.477463 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.477557 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.477790 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.477891 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.478092 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.478183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.478397 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.478495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.478707 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.478805 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.479013 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.479113 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.479322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.479420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.479628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.479733 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.479937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.480062 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.480248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.480377 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.480561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.480690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.480874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.481000 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.481209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.481353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.481521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.481642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.481833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.481961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.482143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.482278 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.482449 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.482586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.482775 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.483008 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.483101 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.483326 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.483438 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.483642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.483749 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.483956 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.484049 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.484301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.484405 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.484610 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.484702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.484930 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.485041 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.485280 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.485383 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.485590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.485682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.485897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.485989 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.486206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.486298 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.486533 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.486814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.486915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.487142 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.487248 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.487461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.487563 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.487770 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.487862 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.488160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.488262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.488491 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.488582 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.488804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.488898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.489133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.489229 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.489446 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.489549 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.489752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.489853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.490063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.490156 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.490387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.490480 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.490691 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.490782 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.490994 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.491094 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.491298 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.491425 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.491623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.491730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.491929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.492024 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.492283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.492381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.492592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.492718 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.492918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.493038 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.493272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.493366 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.493592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.493780 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.493918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.494094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.494336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.494436 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.494663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.494764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.494978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.495071 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.495305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.495409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.495633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.495725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.495943 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.496035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.496252 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.496356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.496567 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.496660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.496878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.496970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.497210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.497320 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.497532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.497669 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.497836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.497944 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.498150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.498386 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.498506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.498721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.498846 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.499040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.499172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.499355 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.499461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.499695 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.500354 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.500540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.500680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.500866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.500971 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.501213 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.501378 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.501540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.501691 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.501847 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.502024 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.502154 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.502255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.502465 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.502559 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.502772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.502864 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.503079 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.503169 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.503388 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.503489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.503696 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.503796 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.504041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.504146 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.504349 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.504442 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.504672 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.504822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.504989 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.505161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.505326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.505420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.505649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.505743 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.505958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.506060 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.506280 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.506372 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.506616 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.506734 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.506935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.507051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.507271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.507377 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.507560 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.507664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.507875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.507983 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.508182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.508279 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.508487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.508587 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.508793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.508896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.509098 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.509215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.509432 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.509603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.509755 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.509906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.510048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.510189 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.510352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.510529 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.510633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.510721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.510940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.511042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.511248 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.511349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.511573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.511673 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.511886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.511981 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.512194 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.512295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.512502 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.512603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.512809 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.512902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.513155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.513261 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.513463 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.513555 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.513773 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.513872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.514078 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.514179 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.514382 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.514475 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.514687 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.514787 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.514996 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.515097 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.515297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.515480 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.515697 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.515847 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.516007 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.516301 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.516401 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.516619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.516718 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.516942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.517042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.517276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.517382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.517582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.517728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.517887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.517989 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.518191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.518291 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.518532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.518729 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.518821 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.519069 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.519192 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.519399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.519553 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.519719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.519854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.520072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.520331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.520465 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.520657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.520765 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.521179 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.521293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.521415 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.521508 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.521624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.521872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.521976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.522063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.522236 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.522387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.522538 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.522696 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.522849 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.522990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.523154 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.523290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.523513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.523665 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.523835 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.523992 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.524155 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.524291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.524475 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.524635 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.524780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.524908 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.525160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.525260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.525484 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.525578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.525796 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.525895 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.526113 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.526206 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.526431 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.526525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.526738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.526828 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.527051 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.527150 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.527363 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.527463 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.527681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.527820 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.527998 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.528100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.528312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.528408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.528630 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.528949 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.529054 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.529298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.529413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.529625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.529739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.529962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.530067 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.530285 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.530397 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.530600 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.530701 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.530913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.531027 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.531271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.531475 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.531572 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.531890 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.532013 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.532211 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.532318 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.532515 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.532654 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.532828 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.532984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.533157 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.533339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.533471 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.533660 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.533787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.533982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.534086 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.534313 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.534409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.534623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.534743 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.534950 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.535052 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.535244 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.535350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.535557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.535668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.535862 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.535961 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.536186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.536447 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.536542 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.536764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.536873 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.537097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.537209 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.537434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.537538 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.537758 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.537970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.538079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.538324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.538637 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.538742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.538965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.539060 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.539279 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.539427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.539587 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.539685 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.539900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.539999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.540210 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.540314 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.540518 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.540620 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.540824 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.540926 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.541166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.541285 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.541484 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.541594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.541793 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.541919 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.542105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.542221 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.542414 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.542713 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.542818 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.543019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.543113 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.543332 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.543427 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.543638 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.543741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.543966 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.544069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.544276 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.544380 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.544585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.544688 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.544892 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.544995 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.545229 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.545346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.545539 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.545640 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.545844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.545939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.546152 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.546256 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.546459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.546554 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.547310 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.547420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.547616 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.547723 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.548020 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.548181 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.548329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.548470 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.548621 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.548778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.548922 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.549160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.549307 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.549467 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.549615 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.549757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.549941 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.550075 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.550225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.550366 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.550516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.550663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.550810 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.550977 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.551113 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.551259 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.551409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.551549 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.551689 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.551919 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.552068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.552286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.552461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.552597 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.552740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.552885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.553025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.553199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.553337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.553529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.553631 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.553854 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.553948 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.554191 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.554293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.554525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.554625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.554834 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.554943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.555136 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.555240 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.555443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.555535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.555751 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.555842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.556070 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.556169 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.556385 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.556485 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.556694 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.556794 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.557004 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.557095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.557343 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.557546 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.557645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.557955 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.558084 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.558267 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.558423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.558577 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.558776 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.558951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.559176 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.559534 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.559759 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.559853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.560077 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.560170 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.560382 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.560473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.560687 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.560780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.561011 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.561175 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.561417 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.561511 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.561732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.561825 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.562047 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.562159 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.562423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.563171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.563342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.563508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.563654 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.563803 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.563948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.564101 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.564252 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.564405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.564556 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.564706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.564858 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.565014 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.565227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.565382 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.565537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.565683 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.565826 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.565977 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.566130 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.566282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.566426 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.566571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.566715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.566859 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.567021 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.567165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.567315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.567458 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.567632 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.567792 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.567944 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.568096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.568265 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.568412 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.568569 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.568718 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.568975 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.569167 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.569275 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.569373 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.569468 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.569565 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.569790 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.569898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.570108 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.570281 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.570427 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.570582 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.570725 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.570876 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.571017 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.571159 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.571329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.571476 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.571642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.571780 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.571947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.572112 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.572258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.572400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.572574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.572725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.572868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.573014 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.573182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.573325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.573472 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.573620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.573759 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.573899 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.574046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.574187 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.574334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.574516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.574617 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.574842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.574936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.575197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.575364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.575513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.575659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.575812 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.575956 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.576103 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.576249 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.576396 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.576554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.576711 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.576856 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.576999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.577168 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.577310 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.577457 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.577610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.577761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.577927 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.578145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.578286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.578571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.578729 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.578876 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.579046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.579197 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.579341 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.579495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.579637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.579786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.579948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.580091 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.580322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.580479 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.580631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.580786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.580928 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.581071 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.581251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.581406 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.581548 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.581692 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.581834 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.581985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.582136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.582315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.582457 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.582714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.582872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.583026 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.583178 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.583403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.583556 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.583702 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.583855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.583998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.584157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.584303 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.584445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.584588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.584750 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.584907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.585055 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.585229 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.585328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.585461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.585599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.585761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.585912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.586055 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.586198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.586349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.586504 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.586610 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.586747 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.586891 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.586983 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.587077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.587172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.587272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.587389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.587494 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.587707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.587804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.588019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.588125 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.588331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.588435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.588651 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.588757 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.588970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.589074 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.589314 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.589412 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.589643 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.589748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.589962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.590064 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.590307 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.590453 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.590621 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.590725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.590970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.591075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.591286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.591381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.591595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.591702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.591907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.592003 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.592245 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.592388 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.592557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.592660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.592869 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.592985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.593127 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120663) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 22:09:31.593240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.593503 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.593840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.594156 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.594473 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.594800 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.595128 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.595447 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.595770 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.596097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.596448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.596762 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.597121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.597453 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.597768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.598079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.598387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 22:09:31.598630 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 22:09:31.655005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Registered counter for database nova_api Sep 22 22:09:31.661660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Registered counter for database nova_api Sep 22 22:09:31.678562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:09:31.682742 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:09:31.685565 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:09:31.690373 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:09:31.742337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.context [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4830448-3328-421e-a52b-a48486017d64(cell1) {{(pid=120663) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 22:09:31.746398 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:09:31.746523 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.context [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4830448-3328-421e-a52b-a48486017d64(cell1) {{(pid=120662) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 22:09:31.746878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:09:31.748430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:09:31.749215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:09:31.749667 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:09:31.751199 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:09:31.751683 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:09:31.752565 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:09:31.753286 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:09:31.754056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:09:31.754509 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:09:31.754631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Registered counter for database nova_cell0 Sep 22 22:09:31.756501 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:09:31.758622 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Registered counter for database nova_cell0 Sep 22 22:09:31.758754 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Registered counter for database nova_cell1 Sep 22 22:09:31.762761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Registered counter for database nova_cell1 Sep 22 22:09:31.767125 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:09:31.768173 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:09:31.772990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:09:31.774213 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:09:31.774333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:09:31.776849 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:09:31.781997 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:09:31.783485 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:09:31.929182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO dbcounter [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Registered counter for database nova_cell0 Sep 22 22:09:31.936569 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_db.sqlalchemy.engines [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120663) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:09:31.938640 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO dbcounter [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Registered counter for database nova_cell0 Sep 22 22:09:31.941945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writer thread running {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:09:31.945291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_db.sqlalchemy.engines [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 22:09:31.949937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writer thread running {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 22:09:32.264502 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 22:09:32.271927 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 22:09:32.272352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 22:09:32.279259 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 22:09:32.620899 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 22:09:32.627755 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: WARNING keystonemiddleware.auth_token [None req-ecd9d077-d48d-4ffa-8a51-14a99a6fbb4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 22:09:32.630986 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 22:09:32.633141 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb67c2c9c0 pid: 120663 (default app) Sep 22 22:09:32.637007 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: WARNING keystonemiddleware.auth_token [None req-acc1357d-2a95-4e2c-b1bd-cb98c3dc53c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 22:09:32.642397 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb67c2c9c0 pid: 120662 (default app) Sep 22 22:10:09.449238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:09.450164 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:09.451044 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:09.453287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:10.104289 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:10.110757 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:10.112389 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:10.114863 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:10.629230 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-459ba0b1-4b2e-43da-83b3-4fbc24d3355f tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Action: 'create', calling method: .version_select at 0x7f405db25430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-245305565"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:11.867616 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3178eafc-3227-4dcf-b8b1-1361e2f3e4e4 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Action: 'create', calling method: .version_select at 0x7f405db254c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-818713658", "metadata": {"Type": "work"}}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:13.115310 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-459ba0b1-4b2e-43da-83b3-4fbc24d3355f tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.671451 Sep 22 22:10:13.116216 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Thu Sep 22 22:10:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3674 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 22 22:10:13.121505 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fcfbda99-9457-4c7d-9306-e14aa595c3da tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405d9f7310>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:13.705027 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3178eafc-3227-4dcf-b8b1-1361e2f3e4e4 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.590369 Sep 22 22:10:13.705027 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 22 22:10:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3594 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 22 22:10:13.705027 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d3ac663c-cf1c-463b-a739-48144dc262d1 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d9f53a0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:13.735381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fcfbda99-9457-4c7d-9306-e14aa595c3da tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c3c81775-d2a2-4761-9151-d31136ab5236" status: 200 len: 350 microversion: 2.1 time: 0.617877 Sep 22 22:10:13.744433 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:13 2022] GET /compute/v2.1/os-volumes/c3c81775-d2a2-4761-9151-d31136ab5236 => generated 350 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:13.749594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-45d03730-16fa-4c80-81d6-30c75a7ce091 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d9f7a60>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:13.963838 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d3ac663c-cf1c-463b-a739-48144dc262d1 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 200 len: 345 microversion: 2.1 time: 0.284474 Sep 22 22:10:13.964629 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:13 2022] GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 345 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:13.979714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-10553a64-670d-4844-be22-b78ace56d8dd tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Action: 'create', calling method: .version_select at 0x7f405d9f5a60>, body: {"snapshot": {"volume_id": "ed30b163-390a-4402-9e30-4c99893bf979", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1212211271"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:14.049975 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-45d03730-16fa-4c80-81d6-30c75a7ce091 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 353 microversion: 2.1 time: 0.304065 Sep 22 22:10:14.050975 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:13 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 353 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:14.065687 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd8a0343-0252-4ff6-bd14-eb5f8dde5897 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d98f1f0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:14.848538 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd8a0343-0252-4ff6-bd14-eb5f8dde5897 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 353 microversion: 2.1 time: 0.788157 Sep 22 22:10:14.850958 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:14 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 353 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:14.866921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9d0da48b-ff65-4049-9975-fa0d4e897767 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d9f7b80>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:15.150766 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-10553a64-670d-4844-be22-b78ace56d8dd tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.176105 Sep 22 22:10:15.151687 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 3/7] 10.222.0.25 () {60 vars in 1162 bytes} [Thu Sep 22 22:10:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:15.164601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1a205164-2732-406d-a2df-6d30adaf3469 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d98fca0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:15.316255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9d0da48b-ff65-4049-9975-fa0d4e897767 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 202 len: 0 microversion: 2.1 time: 0.453895 Sep 22 22:10:15.317146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:10:14 2022] DELETE /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 22:10:15.326672 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-37a0f964-d859-4612-89bf-ee410499f165 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d9f7430>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:15.332257 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1a205164-2732-406d-a2df-6d30adaf3469 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.172797 Sep 22 22:10:15.333580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 4/9] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:15 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:15.345556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7c01a80a-638c-43d1-9623-555d126516ab tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d98f8b0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:15.436947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-37a0f964-d859-4612-89bf-ee410499f165 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.115874 Sep 22 22:10:15.437974 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 6/10] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:15 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:15.439030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7c01a80a-638c-43d1-9623-555d126516ab tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.098494 Sep 22 22:10:15.439667 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 5/11] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Sep 22 22:10:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:15.459832 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-95cc75c8-7d0f-465d-99a8-68ce8a0a301b tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d98f430>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:15.523477 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-95cc75c8-7d0f-465d-99a8-68ce8a0a301b tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.068800 Sep 22 22:10:15.525394 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:15 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:16.125417 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8ace636d-df5b-4ed5-8265-9fc4314c8467 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405d9f59d0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:16.295376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8ace636d-df5b-4ed5-8265-9fc4314c8467 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c57afa16-88ab-46bd-9c76-d114f2e52777" status: 200 len: 350 microversion: 2.1 time: 0.176057 Sep 22 22:10:16.308116 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 6/13] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:16 2022] GET /compute/v2.1/os-volumes/c57afa16-88ab-46bd-9c76-d114f2e52777 => generated 350 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:16.453391 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7e4243b4-8982-41d6-804a-4c33446ffa8d tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d9f73a0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:16.537372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3c89089b-b7a2-4d12-be65-c1057be9a115 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d9f5160>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:16.570942 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7e4243b4-8982-41d6-804a-4c33446ffa8d tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.122801 Sep 22 22:10:16.572569 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 8/14] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:16 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:16.603226 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3c89089b-b7a2-4d12-be65-c1057be9a115 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.069796 Sep 22 22:10:16.610809 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 7/15] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:16 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:17.587628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-00fb281f-2508-4791-9591-5a168b5f54d1 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d9f7af0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:17.616826 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8b870cec-ab4e-40ce-8d55-d0f2738631a6 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d9f5940>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:17.684514 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8b870cec-ab4e-40ce-8d55-d0f2738631a6 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.071431 Sep 22 22:10:17.685592 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:17 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:17.713358 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-00fb281f-2508-4791-9591-5a168b5f54d1 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.130386 Sep 22 22:10:17.714585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:17 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:18.700614 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3cb793ea-9af2-46a4-a644-5af52e4aa3d1 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405e352820>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:18.728137 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e3e4c46d-cb55-48ca-95ca-1ee1ef52764c tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d98f820>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:18.792834 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3cb793ea-9af2-46a4-a644-5af52e4aa3d1 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.098727 Sep 22 22:10:18.797403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 9/18] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:18 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:18.885859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e3e4c46d-cb55-48ca-95ca-1ee1ef52764c tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.160820 Sep 22 22:10:18.886791 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 10/19] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:18 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:19.805720 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-32aed6e3-dcde-41af-9412-056cd32afdf0 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d98f670>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:19.878377 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-32aed6e3-dcde-41af-9412-056cd32afdf0 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.076630 Sep 22 22:10:19.879050 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 10/20] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:19 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:19.903051 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3ef3b332-197e-4dca-b7d0-aaed24c2eb2f tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d9f7dc0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:20.070307 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3ef3b332-197e-4dca-b7d0-aaed24c2eb2f tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.173085 Sep 22 22:10:20.082407 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:19 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:20.143438 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1542746538", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "networks": [{"uuid": "9a795bf6-043e-463b-a8c2-1515f286856d"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:20.321559 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5c9e3b78-cb3b-4da7-9584-659112c125e6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: .version_select at 0x7f405d9f7790>, body: {"keypair": {"name": "tempest-keypair-1595871874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjysmtrUaLKUSPGUznMMveQyrsv4h8esKLmUaXTUFKSXbMpmy23OlhN6Xupo8a2inGqUCcEtMC6DH3ynCju+hKHbcWHQ3i39jhPZpOX5hSHTp4Q5Zyv3K9+zL7sJo3OEg=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:20.372155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] validate_networks() for [('9a795bf6-043e-463b-a8c2-1515f286856d', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:10:20.414218 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-5c9e3b78-cb3b-4da7-9584-659112c125e6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for project 226257b343d24054bc2178b47a9a5a4f. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:10:20.428705 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-5c9e3b78-cb3b-4da7-9584-659112c125e6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for user bcb617f1f41c467fba9717f7f825ac80 and project 226257b343d24054bc2178b47a9a5a4f. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:10:20.530783 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5c9e3b78-cb3b-4da7-9584-659112c125e6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.321976 Sep 22 22:10:20.531615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 12/22] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:10:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:20.893911 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-74986d66-3b31-4384-9dbb-e0b4df5efc1e tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d9788b0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:20.967539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-74986d66-3b31-4384-9dbb-e0b4df5efc1e tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.078511 Sep 22 22:10:20.968172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 13/23] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:20 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:21.090955 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-42e176a9-8a83-4b56-9bd1-fcff6bbff68f tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d978f70>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:21.171392 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-42e176a9-8a83-4b56-9bd1-fcff6bbff68f tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.088267 Sep 22 22:10:21.172080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 14/24] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:21 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:21.326390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1658756844", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:21.479560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] validate_networks() for [('770f63d9-fbe3-4433-90af-714bf608e28c', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:10:22.092435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:10:22.092942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:10:22.093887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:10:22.094302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:10:22.094717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:10:22.143251 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:22.146076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:22.146721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:22.147724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:22.148948 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:22.151276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:22.244516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Getting quotas for project 2a52e44d03f74727863b596c606ee35d. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:10:22.260841 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Getting quotas for user 1c9c1aa9349f43e9b56ea4248c3c7f36 and project 2a52e44d03f74727863b596c606ee35d. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:10:22.296654 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:10:22.299605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:10:22.400276 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:10:22.400773 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:10:22.401189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:10:22.401815 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:10:22.402227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:10:22.410605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ed714bdc-0fa6-4972-bd30-d9f2ff42d65e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.372042 Sep 22 22:10:22.411894 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 11/25] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:10:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 22:10:22.416591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:22.417081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:22.417556 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:22.418898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:22.419511 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:22.419938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:22.420537 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c4dcd1d4-9098-44cb-bb40-5f1903e3fca3 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d0b10d0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:22.452874 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Getting quotas for project 0499a794df4444b594ee3126a8e210c1. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:10:22.459976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Getting quotas for user ca01fc46c837486b808390ff0c48fa1f and project 0499a794df4444b594ee3126a8e210c1. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:10:22.475308 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:10:22.480362 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:10:22.520291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c4dcd1d4-9098-44cb-bb40-5f1903e3fca3 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 288 microversion: 2.1 time: 0.106504 Sep 22 22:10:22.525564 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 12/26] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:22 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:22.527593 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-98f5cf10-4cb8-4175-824c-35ed34d3ad4d tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d0b1820>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:22.603131 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24b78a4b-0146-42d9-af75-e22fc0f5c71f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.369966 Sep 22 22:10:22.604442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 15/27] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:10:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 22:10:22.611659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-81f4d1ce-cf16-49b9-a256-56168cfac962 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:22.612558 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-81f4d1ce-cf16-49b9-a256-56168cfac962 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:22.655732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-98f5cf10-4cb8-4175-824c-35ed34d3ad4d tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.126201 Sep 22 22:10:22.665674 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 13/28] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:22 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:22.686890 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b6b78f7c-9baa-4bd0-8711-ec81e616c2bb tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d0b1f70>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:22.860840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b6b78f7c-9baa-4bd0-8711-ec81e616c2bb tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 202 len: 0 microversion: 2.1 time: 0.193718 Sep 22 22:10:22.864693 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Sep 22 22:10:22 2022] DELETE /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:10:22.870573 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6a5387ed-f02d-46ff-9f70-fa615ae4e29a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:22.872766 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6a5387ed-f02d-46ff-9f70-fa615ae4e29a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:22.880643 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-81f4d1ce-cf16-49b9-a256-56168cfac962 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:22.911334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-81f4d1ce-cf16-49b9-a256-56168cfac962 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1215 microversion: 2.1 time: 0.302159 Sep 22 22:10:22.912508 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 16/30] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:22 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1215 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:22.920912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4981c33b-b9e0-47e1-84f8-596cc130d706 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d059670>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:23.003663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4981c33b-b9e0-47e1-84f8-596cc130d706 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.088709 Sep 22 22:10:23.004650 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 17/31] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:22 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:23.025364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6a5387ed-f02d-46ff-9f70-fa615ae4e29a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:23.060178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6a5387ed-f02d-46ff-9f70-fa615ae4e29a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1222 microversion: 2.1 time: 0.192863 Sep 22 22:10:23.063318 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 15/32] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:22 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:23.178966 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1361813535", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:23.278391 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] validate_networks() for [('770f63d9-fbe3-4433-90af-714bf608e28c', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:10:23.673083 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5718f48e-cf73-41e7-9643-f84d7ea91529 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d0b1820>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:23.815922 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5718f48e-cf73-41e7-9643-f84d7ea91529 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.148537 Sep 22 22:10:23.826257 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 16/33] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:23 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:23.833130 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1171341147", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76b70dbd-430e-4822-82a3-49c7f238d2e2"}], "security_groups": [{"name": "tempest-securitygroup--1902746589"}], "key_name": "tempest-keypair-1595871874", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:24.212419 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] validate_networks() for [('76b70dbd-430e-4822-82a3-49c7f238d2e2', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:10:24.419792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:10:24.420350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:10:24.420668 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:10:24.421151 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:10:24.421673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:10:24.438673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:24.439165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:24.439597 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:24.440388 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:24.440838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:24.441589 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:24.501843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Getting quotas for project 0499a794df4444b594ee3126a8e210c1. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:10:24.514036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Getting quotas for user ca01fc46c837486b808390ff0c48fa1f and project 0499a794df4444b594ee3126a8e210c1. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:10:24.534584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:10:24.541912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:10:24.669660 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8350cc80-c3bf-4461-9d20-e64b852c66f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.492731 Sep 22 22:10:24.671431 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 18/34] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:10:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:10:24.676342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:24.686611 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:24.701036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:24.702024 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:24.702776 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:24.703946 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:24.704535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:24.705093 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:24.905771 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:24.936896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-803bff4c-6e25-4070-af06-e1b56c9c08c9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1219 microversion: 2.1 time: 0.264193 Sep 22 22:10:24.941187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 19/35] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:24 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1219 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:24.946592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b0eba72-9e84-4de2-8a8b-c4b8c9d9222e tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d072dc0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:24.995506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7b0eba72-9e84-4de2-8a8b-c4b8c9d9222e tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.053090 Sep 22 22:10:24.996633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 20/36] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:24 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:25.009456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-62f8a535-aac4-4623-a4ac-169a8b2bd618 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:25.010790 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-62f8a535-aac4-4623-a4ac-169a8b2bd618 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:25.103639 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-62f8a535-aac4-4623-a4ac-169a8b2bd618 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:25.115915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-62f8a535-aac4-4623-a4ac-169a8b2bd618 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1222 microversion: 2.1 time: 0.115501 Sep 22 22:10:25.118616 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 21/37] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:24 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:25.130317 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-62b8e60f-0bbc-481a-b310-1aca76a6975e tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405cff1af0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:25.204667 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:10:25.206141 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:10:25.206938 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:10:25.208387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:10:25.209114 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:10:25.220362 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-62b8e60f-0bbc-481a-b310-1aca76a6975e tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.100482 Sep 22 22:10:25.221304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 22/38] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:25 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:25.236104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:25.236894 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:25.238468 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:25.239484 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:25.240114 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:25.240702 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:25.264147 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for project 226257b343d24054bc2178b47a9a5a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:10:25.269482 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for user bcb617f1f41c467fba9717f7f825ac80 and project 226257b343d24054bc2178b47a9a5a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:10:25.284538 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:10:25.287452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:10:25.363899 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-20839542-3a06-481e-b15a-cf8c536c9d16 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.535523 Sep 22 22:10:25.364921 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 17/39] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:10:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:10:25.376913 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4b8aacc2-fa4f-4df6-8afb-6ba05a1e8c8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:25.377946 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4b8aacc2-fa4f-4df6-8afb-6ba05a1e8c8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:25.470505 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4b8aacc2-fa4f-4df6-8afb-6ba05a1e8c8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:25.479736 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4b8aacc2-fa4f-4df6-8afb-6ba05a1e8c8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1242 microversion: 2.1 time: 0.107207 Sep 22 22:10:25.481814 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 23/40] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:25 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1242 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:25.968722 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:25.969548 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:25.979719 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:25.985704 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:25.986254 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:25.988182 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:25.988662 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:25.989119 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:26.010036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f88b26d2-9ea7-47c6-b2c6-936afe7f78de tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405cf8e040>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:26.083805 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f88b26d2-9ea7-47c6-b2c6-936afe7f78de tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.078779 Sep 22 22:10:26.084866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 24/41] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:26 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:26.143988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:26.144607 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:26.177047 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:26.177664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:26.181300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:26.183402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:26.186236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:26.186646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:26.208508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:26.224425 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fe9b0d66-b2e8-4a70-b74d-7d622fadee63 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1219 microversion: 2.1 time: 0.259822 Sep 22 22:10:26.241801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 18/42] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:25 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1219 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:26.248210 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f2b4639f-5948-4980-b995-6f9e522c66e1 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405cfe4790>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:26.312991 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:26.325462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1ec1dcb8-2ec8-49ef-be9f-d508d0661150 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1226 microversion: 2.1 time: 0.185970 Sep 22 22:10:26.337147 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f2b4639f-5948-4980-b995-6f9e522c66e1 tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.086598 Sep 22 22:10:26.337147 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 19/43] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:26 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:26.338236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 25/44] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:26 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1226 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:26.504000 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:26.504649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:26.521977 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:26.522959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:26.524991 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:26.526113 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:26.528512 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:26.529482 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:26.605557 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:26.613416 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ab90133d-12cf-4b64-803a-37e2fe272448 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1246 microversion: 2.1 time: 0.113177 Sep 22 22:10:26.616201 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 20/45] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:26 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:27.097034 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-73e96a67-c8aa-4c61-b8eb-600dcc6bb334 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405d072dc0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:27.140680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-73e96a67-c8aa-4c61-b8eb-600dcc6bb334 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 200 len: 287 microversion: 2.1 time: 0.047312 Sep 22 22:10:27.141303 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 26/46] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:27 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:27.248612 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:27.250025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:27.270008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:27.273886 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:27.274375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:27.279552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:27.280590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:27.281455 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:27.344887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd876010-c934-471a-a475-e8982a2f70da tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d0770d0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:27.488588 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd876010-c934-471a-a475-e8982a2f70da tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 200 len: 352 microversion: 2.1 time: 0.148644 Sep 22 22:10:27.489320 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 27/47] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:27 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 352 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:27.495374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:27.497884 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:27.512097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:27.532102 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4104b2a0-4ead-4728-9dee-3186fe6a8fd6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1275 microversion: 2.1 time: 0.287804 Sep 22 22:10:27.534546 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 21/48] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:27 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1275 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:27.536548 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:27.537220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:27.537937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:27.539087 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:27.539755 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:27.540389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:27.637426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:27.639325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:27.661299 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:27.662170 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:27.663314 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:27.673615 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:27.675096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:27.676244 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:27.735183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:27.756022 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ca72f68d-1b8c-4e9d-a552-64aa795a34b3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1218 microversion: 2.1 time: 0.263307 Sep 22 22:10:27.756666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 28/49] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:27 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1218 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:27.855116 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:27.868677 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fb012286-71c6-431b-95c4-cd27719e0c90 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1238 microversion: 2.1 time: 0.235209 Sep 22 22:10:27.869813 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 22/50] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:27 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1238 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:28.170337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8acdb2ae-c406-47e0-83d1-c08f14ca4b89 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405cf99820>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.171445 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-56c90b73-4621-47e7-8786-34078d6f90eb tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405d051d30>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.232946 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-56c90b73-4621-47e7-8786-34078d6f90eb tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/780f4ebe-979a-442d-bc6f-87031b91fb10" status: 200 len: 350 microversion: 2.1 time: 0.065368 Sep 22 22:10:28.233634 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 23/51] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/os-volumes/780f4ebe-979a-442d-bc6f-87031b91fb10 => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:28.247948 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4ca401c8-5d03-46a0-adaf-10fe1ff53e59 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405cfaac10>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.281615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-8acdb2ae-c406-47e0-83d1-c08f14ca4b89 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] HTTP exception thrown: Snapshot 975e78ce-c233-4cde-b9c0-de991ef39501 could not be found. Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8acdb2ae-c406-47e0-83d1-c08f14ca4b89 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Request method failure captured: Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 HTTP/1.1 Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1BzxtYGhAqsM949V0ITHDoZg_BLgGXOlTy0WUp6CqWLcdvG3lQROQaBmYYQ17xQDRRwMlEZvx-V5-U9HvCwQxHhyD9pBdg0fWyIxAroaED3rD8fir089ULAHPa8C5dR8D7b8LGxJiU-EOPlqY5W3n2ZJ0jMKHeTmUL6dKeakE9xP4 Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 4e9bfc4da4e1421e94de0946e1e5251f Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:10:28.287319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e9bfc4da4e1421e94de0946e1e5251f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 4e9bfc4da4e1421e94de0946e1e5251f Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotsTestJSON-1999448492-project Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 067449d36a684dc6aa42f70f412817b4 Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1999448492-project Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Snapshot 975e78ce-c233-4cde-b9c0-de991ef39501 could not be found. Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '975e78ce-c233-4cde-b9c0-de991ef39501'} Sep 22 22:10:28.288469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 975e78ce-c233-4cde-b9c0-de991ef39501 could not be found. (HTTP 404) (Request-ID: req-f3925320-4390-483e-a8de-d1eba9d30867) Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.289208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:28.290637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 975e78ce-c233-4cde-b9c0-de991ef39501 could not be found. Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 22 22:10:28.291710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 975e78ce-c233-4cde-b9c0-de991ef39501 could not be found. Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 975e78ce-c233-4cde-b9c0-de991ef39501 could not be found. Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8acdb2ae-c406-47e0-83d1-c08f14ca4b89 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Returning 404 to user: Snapshot 975e78ce-c233-4cde-b9c0-de991ef39501 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:28.294409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8acdb2ae-c406-47e0-83d1-c08f14ca4b89 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501" status: 404 len: 111 microversion: 2.1 time: 0.140759 Sep 22 22:10:28.295970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 29/52] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/os-snapshots/975e78ce-c233-4cde-b9c0-de991ef39501 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:10:28.304037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e88da087-eae0-4b2f-9fb1-c9c17e5aa54a tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405e3528b0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.409066 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4ca401c8-5d03-46a0-adaf-10fe1ff53e59 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.165285 Sep 22 22:10:28.410295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 24/53] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:28.426410 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-95949a2a-3678-4194-bb59-b00a4a519e0c tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405cf504c0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.505637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e88da087-eae0-4b2f-9fb1-c9c17e5aa54a tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 202 len: 0 microversion: 2.1 time: 0.209633 Sep 22 22:10:28.506210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 30/54] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:10:28 2022] DELETE /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:10:28.510787 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-56f65d0a-5b3f-4981-96c1-09530d188b3a tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Calling method '.version_select at 0x7f405d072b80>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.576761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-56f65d0a-5b3f-4981-96c1-09530d188b3a tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] HTTP exception thrown: Volume e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf could not be found. Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-56f65d0a-5b3f-4981-96c1-09530d188b3a tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Request method failure captured: Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf HTTP/1.1 Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1BuB-BwP5xfTYHHh70Ho49WNOenReyQKf5826fbc4sXRLmkeFwtLlAbwcI6hkzBy1LP4NnLcDnvRH7tWdck0yoxMjIhTPd2_gu2w7__crGymPjEuLKxfxrQJL8d6VSVO7yAAFffjTym4iI-A8iOfWD4EM6uq6Qa6xfPQBeKbDABB0 Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 597b434b0f3e4187b6931397d868ca89 Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesGetTestJSON-854892494 Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:10:28.579040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/597b434b0f3e4187b6931397d868ca89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/597b434b0f3e4187b6931397d868ca89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/597b434b0f3e4187b6931397d868ca89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_597b434b0f3e4187b6931397d868ca89", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesGetTestJSON-854892494 Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 597b434b0f3e4187b6931397d868ca89 Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesGetTestJSON-854892494 Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesGetTestJSON-854892494-project Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: e6bc9e299582487c80d70866ef26a651 Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesGetTestJSON-854892494-project Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Volume e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf could not be found. Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf'} Sep 22 22:10:28.580199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf could not be found. (HTTP 404) (Request-ID: req-24b23989-f5c6-4418-8824-b6391c256a07) Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:28.580896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:28.583443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf could not be found. Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 22:10:28.584625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf could not be found. Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf could not be found. Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:28.585871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-56f65d0a-5b3f-4981-96c1-09530d188b3a tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] Returning 404 to user: Volume e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:28.587357 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-56f65d0a-5b3f-4981-96c1-09530d188b3a tempest-VolumesGetTestJSON-854892494 tempest-VolumesGetTestJSON-854892494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf" status: 404 len: 109 microversion: 2.1 time: 0.075818 Sep 22 22:10:28.588455 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 31/55] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/os-volumes/e98b4a44-dcb1-405b-89e9-b17b2d6bdfaf => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:10:28.597981 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-02abb2fc-d5f6-499a-9ed8-67e78c00cf95 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405cf5d040>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.678971 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-95949a2a-3678-4194-bb59-b00a4a519e0c tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.256423 Sep 22 22:10:28.680761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 25/56] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:28.697853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.698988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:28.710965 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:28.711779 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:28.712408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:28.713962 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:28.714602 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:28.715222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:28.724720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-02abb2fc-d5f6-499a-9ed8-67e78c00cf95 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 200 len: 344 microversion: 2.1 time: 0.134967 Sep 22 22:10:28.725527 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 32/57] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:28.731052 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ecd7fac6-071c-4e28-833e-8dd2f0f8c035 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405d072940>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.805736 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:28.817409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a21d1b68-fdce-4029-ab2a-29bf7f9db4e6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1273 microversion: 2.1 time: 0.123255 Sep 22 22:10:28.818350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 26/58] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:28.823448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.825037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:28.843215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:28.845967 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:28.846598 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:28.847409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:28.850043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:28.850786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:28.978677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ecd7fac6-071c-4e28-833e-8dd2f0f8c035 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.251910 Sep 22 22:10:28.979242 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 33/59] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:28.984341 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:28.985287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:28.991408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:29.001756 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:29.002621 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:29.003990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-86ceecf4-7301-4167-b0aa-511416c25beb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1274 microversion: 2.1 time: 0.184314 Sep 22 22:10:29.004543 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 27/60] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1274 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:29.016822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8d9949da-81f6-4df6-b495-275bf19349ea tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405cf503a0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:29.021698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:29.022470 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:29.023202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:29.024705 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:29.140766 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:29.152725 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7c0e3fd9-21d4-4764-bba8-d832ed15e56d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1238 microversion: 2.1 time: 0.172114 Sep 22 22:10:29.171123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 34/61] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:28 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1238 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:29.212924 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8d9949da-81f6-4df6-b495-275bf19349ea tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.207051 Sep 22 22:10:29.221565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 28/62] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Sep 22 22:10:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:29.233939 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d6297206-d9f4-4e95-842f-80b872b7e426 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405e352790>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:29.382643 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d6297206-d9f4-4e95-842f-80b872b7e426 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.152733 Sep 22 22:10:29.383216 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 35/63] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Sep 22 22:10:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:29.398350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8eda22b3-a100-4343-8f90-58a3bed211d6 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405cfaaca0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:29.499969 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8eda22b3-a100-4343-8f90-58a3bed211d6 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.106347 Sep 22 22:10:29.500582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 29/64] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Sep 22 22:10:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:29.514955 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-584a0999-9848-4b62-9a30-751ec1f01184 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405cf5d8b0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:29.620344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-584a0999-9848-4b62-9a30-751ec1f01184 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.109890 Sep 22 22:10:29.621690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 36/65] 10.222.0.25 () {58 vars in 1188 bytes} [Thu Sep 22 22:10:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:29.635131 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-baf69666-1f27-4297-a07d-ee67aeba0283 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] Calling method '.version_select at 0x7f405cf61790>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:29.741520 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6f87c1b3-df4d-470f-b4ab-ece7eb8165f2 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405cf64790>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:29.749273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-baf69666-1f27-4297-a07d-ee67aeba0283 tempest-VolumesTestJSON-596964269 tempest-VolumesTestJSON-596964269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.117761 Sep 22 22:10:29.749885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 30/66] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Sep 22 22:10:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:29.817169 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6f87c1b3-df4d-470f-b4ab-ece7eb8165f2 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 200 len: 344 microversion: 2.1 time: 0.080595 Sep 22 22:10:29.817764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 37/67] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:29 2022] GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:29.846384 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:29.847357 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:29.859355 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:29.860092 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:29.860706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:29.861902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:29.862559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:29.863427 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:30.030114 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:30.031030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:30.043784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:30.044303 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:30.044738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:30.045483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:30.045938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:30.048492 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:30.097637 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:30.109432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dc74442d-2253-40b9-998c-ba0745289af4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.268579 Sep 22 22:10:30.113758 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 31/68] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:29 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:30.155595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:30.164173 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4d4b3128-e436-4e58-816a-4ad7ec7d5745 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1274 microversion: 2.1 time: 0.139469 Sep 22 22:10:30.164845 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 38/69] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:30 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:30.177795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:30.179917 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:30.187932 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:30.188415 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:30.189046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:30.189766 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:30.190369 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:30.190941 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:30.265405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:30.275610 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-80d84739-05b9-468f-9508-bb51ad4ee9ec tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1238 microversion: 2.1 time: 0.101516 Sep 22 22:10:30.277237 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 32/70] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:30 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:30.831649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0c4cbcf2-0db0-4116-a69b-5d63aeeaaccc tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405cfaaf70>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:30.868342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-25d26e7d-2128-45d3-858a-faa7759a59b1 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Action: 'create', calling method: .version_select at 0x7f405cfffd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-70591537", "metadata": {"Type": "work"}}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-25d26e7d-2128-45d3-858a-faa7759a59b1 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Request method failure captured: Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 120 Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1Wf_Ad2V94d2T3Z6KDYyilJ2_qdWG836zV02QSq6-NaDFglxphsAcq99UBLthM-hUSzW2hV0Qzc4wmNt2kXlIIHveuh3McCT278D3q6VA-ZcXLAWtu6EVBSN2lSjIFSbw1AGNd8TjlGqac5E5qUy1hUQN9nBqkk3xnCV9o4znFbmE Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:10:30.873494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09cebeea756d4e62b048c973e899b43b", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: b9a42074b397453b97fc849260c2c10b Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-70591537", "metadata": {"Type": "work"}}} Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: Sep 22 22:10:30.874878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-70591537', 'metadata': {'Type': 'work'}}}} Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise error Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi '#$%' Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:30.875779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 22:10:30.877154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 22:10:30.878257 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 22:10:30.878257 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.878257 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-25d26e7d-2128-45d3-858a-faa7759a59b1 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:30.878257 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-25d26e7d-2128-45d3-858a-faa7759a59b1 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.125352 Sep 22 22:10:30.878257 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 39/71] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 22 22:10:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 22:10:30.883714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0c4cbcf2-0db0-4116-a69b-5d63aeeaaccc tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 200 len: 344 microversion: 2.1 time: 0.055798 Sep 22 22:10:30.884265 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5ddf5406-8045-45a5-bcf0-29d164ea394a tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Action: 'create', calling method: .version_select at 0x7f405cefd1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-32805149", "metadata": {"Type": "work"}}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:30.884407 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 33/72] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:30 2022] GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5ddf5406-8045-45a5-bcf0-29d164ea394a tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Request method failure captured: Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 118 Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1Wf_Ad2V94d2T3Z6KDYyilJ2_qdWG836zV02QSq6-NaDFglxphsAcq99UBLthM-hUSzW2hV0Qzc4wmNt2kXlIIHveuh3McCT278D3q6VA-ZcXLAWtu6EVBSN2lSjIFSbw1AGNd8TjlGqac5E5qUy1hUQN9nBqkk3xnCV9o4znFbmE Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:10:30.889399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09cebeea756d4e62b048c973e899b43b", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: b9a42074b397453b97fc849260c2c10b Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-32805149", "metadata": {"Type": "work"}}} Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: Sep 22 22:10:30.890741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-32805149', 'metadata': {'Type': 'work'}}}} Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise error Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi '0' Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:30.891523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 22:10:30.892609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 22:10:30.893628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 22:10:30.893628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.893628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5ddf5406-8045-45a5-bcf0-29d164ea394a tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:30.893628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5ddf5406-8045-45a5-bcf0-29d164ea394a tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010264 Sep 22 22:10:30.893628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 40/73] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 22 22:10:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 22 22:10:30.899658 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-74e97ee2-7889-4f03-92e7-8c0f2423e378 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Action: 'create', calling method: .version_select at 0x7f405cf509d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1946549775", "metadata": {"Type": "work"}}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-74e97ee2-7889-4f03-92e7-8c0f2423e378 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Request method failure captured: Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 119 Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1Wf_Ad2V94d2T3Z6KDYyilJ2_qdWG836zV02QSq6-NaDFglxphsAcq99UBLthM-hUSzW2hV0Qzc4wmNt2kXlIIHveuh3McCT278D3q6VA-ZcXLAWtu6EVBSN2lSjIFSbw1AGNd8TjlGqac5E5qUy1hUQN9nBqkk3xnCV9o4znFbmE Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:10:30.905497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09cebeea756d4e62b048c973e899b43b", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: b9a42074b397453b97fc849260c2c10b Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1946549775", "metadata": {"Type": "work"}}} Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: Sep 22 22:10:30.906880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1946549775', 'metadata': {'Type': 'work'}}}} Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise error Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi '' Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:30.907771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 22:10:30.909209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 22:10:30.910620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 22:10:30.910620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.910620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-74e97ee2-7889-4f03-92e7-8c0f2423e378 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:30.910620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-74e97ee2-7889-4f03-92e7-8c0f2423e378 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010969 Sep 22 22:10:30.910620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 34/74] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 22 22:10:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 22:10:30.915584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a26a1d9e-bb91-4136-a009-2ee8913ae4b2 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Calling method '.version_select at 0x7f405cfbcb80>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:30.943990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-a26a1d9e-bb91-4136-a009-2ee8913ae4b2 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] HTTP exception thrown: Volume tempest-invalid-471692283 could not be found. Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a26a1d9e-bb91-4136-a009-2ee8913ae4b2 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Request method failure captured: Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-471692283 HTTP/1.1 Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1Wf_Ad2V94d2T3Z6KDYyilJ2_qdWG836zV02QSq6-NaDFglxphsAcq99UBLthM-hUSzW2hV0Qzc4wmNt2kXlIIHveuh3McCT278D3q6VA-ZcXLAWtu6EVBSN2lSjIFSbw1AGNd8TjlGqac5E5qUy1hUQN9nBqkk3xnCV9o4znFbmE Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:10:30.945920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09cebeea756d4e62b048c973e899b43b", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: b9a42074b397453b97fc849260c2c10b Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Volume tempest-invalid-471692283 could not be found. Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'tempest-invalid-471692283'} Sep 22 22:10:30.947219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-471692283 could not be found. (HTTP 404) (Request-ID: req-7242f343-d38f-45cd-b721-452dc06fd512) Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:30.947887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 22:10:30.949537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-471692283 could not be found. Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:10:30.950461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-471692283 could not be found. Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-471692283 could not be found. Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a26a1d9e-bb91-4136-a009-2ee8913ae4b2 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Returning 404 to user: Volume tempest-invalid-471692283 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a26a1d9e-bb91-4136-a009-2ee8913ae4b2 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-471692283" status: 404 len: 98 microversion: 2.1 time: 0.035962 Sep 22 22:10:30.951437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 41/75] 10.222.0.25 () {58 vars in 1215 bytes} [Thu Sep 22 22:10:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-471692283 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 22 22:10:30.959233 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a18beabd-1d82-4faa-8dd0-22ab4312240d tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004734 Sep 22 22:10:30.959740 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 35/76] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Sep 22 22:10:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 22 22:10:30.978206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9ef6f482-b4be-4812-911b-0bbdd1985f5a tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004476 Sep 22 22:10:30.978206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 42/77] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Sep 22 22:10:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 22 22:10:30.979025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f932b941-b703-4591-b300-7cbe8a2bb051 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Calling method '.version_select at 0x7f405cfe4280>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:31.007210 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-f932b941-b703-4591-b300-7cbe8a2bb051 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] HTTP exception thrown: Volume 8b8d6d79-de5e-41f6-bbdc-d135864facdc could not be found. Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f932b941-b703-4591-b300-7cbe8a2bb051 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Request method failure captured: Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/os-volumes/8b8d6d79-de5e-41f6-bbdc-d135864facdc HTTP/1.1 Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1Wf_Ad2V94d2T3Z6KDYyilJ2_qdWG836zV02QSq6-NaDFglxphsAcq99UBLthM-hUSzW2hV0Qzc4wmNt2kXlIIHveuh3McCT278D3q6VA-ZcXLAWtu6EVBSN2lSjIFSbw1AGNd8TjlGqac5E5qUy1hUQN9nBqkk3xnCV9o4znFbmE Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:10:31.010715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09cebeea756d4e62b048c973e899b43b", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: b9a42074b397453b97fc849260c2c10b Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Volume 8b8d6d79-de5e-41f6-bbdc-d135864facdc could not be found. Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '8b8d6d79-de5e-41f6-bbdc-d135864facdc'} Sep 22 22:10:31.012822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b8d6d79-de5e-41f6-bbdc-d135864facdc could not be found. (HTTP 404) (Request-ID: req-57aa13ef-cad4-41ed-ad15-fdc55a68c57b) Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:31.013706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 22:10:31.014911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b8d6d79-de5e-41f6-bbdc-d135864facdc could not be found. Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 22:10:31.016228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b8d6d79-de5e-41f6-bbdc-d135864facdc could not be found. Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b8d6d79-de5e-41f6-bbdc-d135864facdc could not be found. Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f932b941-b703-4591-b300-7cbe8a2bb051 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Returning 404 to user: Volume 8b8d6d79-de5e-41f6-bbdc-d135864facdc could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f932b941-b703-4591-b300-7cbe8a2bb051 tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/8b8d6d79-de5e-41f6-bbdc-d135864facdc" status: 404 len: 109 microversion: 2.1 time: 0.037467 Sep 22 22:10:31.017700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 36/78] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:10:30 2022] DELETE /compute/v2.1/os-volumes/8b8d6d79-de5e-41f6-bbdc-d135864facdc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:10:31.022140 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2dc4d09f-a9bd-4eeb-8bf5-f1d58c58746b tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Calling method '.version_select at 0x7f405cfbc940>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:31.049531 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-2dc4d09f-a9bd-4eeb-8bf5-f1d58c58746b tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] HTTP exception thrown: Volume 99b9fbb7-2117-4d39-bb37-af75d0b5d6a3 could not be found. Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2dc4d09f-a9bd-4eeb-8bf5-f1d58c58746b tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Request method failure captured: Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-volumes/99b9fbb7-2117-4d39-bb37-af75d0b5d6a3 HTTP/1.1 Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1Wf_Ad2V94d2T3Z6KDYyilJ2_qdWG836zV02QSq6-NaDFglxphsAcq99UBLthM-hUSzW2hV0Qzc4wmNt2kXlIIHveuh3McCT278D3q6VA-ZcXLAWtu6EVBSN2lSjIFSbw1AGNd8TjlGqac5E5qUy1hUQN9nBqkk3xnCV9o4znFbmE Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:10:31.051256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09cebeea756d4e62b048c973e899b43b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09cebeea756d4e62b048c973e899b43b", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 09cebeea756d4e62b048c973e899b43b Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-1649694167 Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: b9a42074b397453b97fc849260c2c10b Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-1649694167-project Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Volume 99b9fbb7-2117-4d39-bb37-af75d0b5d6a3 could not be found. Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '99b9fbb7-2117-4d39-bb37-af75d0b5d6a3'} Sep 22 22:10:31.052402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99b9fbb7-2117-4d39-bb37-af75d0b5d6a3 could not be found. (HTTP 404) (Request-ID: req-67c39063-2836-4842-a988-2383f58816db) Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:31.053054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:31.054007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99b9fbb7-2117-4d39-bb37-af75d0b5d6a3 could not be found. Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 22:10:31.057142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99b9fbb7-2117-4d39-bb37-af75d0b5d6a3 could not be found. Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99b9fbb7-2117-4d39-bb37-af75d0b5d6a3 could not be found. Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2dc4d09f-a9bd-4eeb-8bf5-f1d58c58746b tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] Returning 404 to user: Volume 99b9fbb7-2117-4d39-bb37-af75d0b5d6a3 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2dc4d09f-a9bd-4eeb-8bf5-f1d58c58746b tempest-VolumesNegativeTest-1649694167 tempest-VolumesNegativeTest-1649694167-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/99b9fbb7-2117-4d39-bb37-af75d0b5d6a3" status: 404 len: 109 microversion: 2.1 time: 0.035297 Sep 22 22:10:31.059704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 43/79] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:31 2022] GET /compute/v2.1/os-volumes/99b9fbb7-2117-4d39-bb37-af75d0b5d6a3 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:10:31.138040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:31.139264 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:31.146678 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:31.147651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:31.148506 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:31.149950 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:31.150875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:31.151754 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:31.188684 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:31.189337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:31.197138 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:31.197138 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:31.197446 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:31.198485 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:31.199665 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:31.200122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:31.286881 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:31.295756 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2f96a22d-bef1-4df4-9cdb-a9c1eff919d7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1274 microversion: 2.1 time: 0.111025 Sep 22 22:10:31.309630 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 44/80] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:31 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:31.309630 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:31.309630 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:31.312679 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:31.313217 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:31.313644 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:31.314342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:31.314798 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:31.315225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:31.335054 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:31.344958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c2a3d634-b8e0-4dec-9940-1a986b5ec663 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.211341 Sep 22 22:10:31.345680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 37/81] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:31 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:31.383889 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:31.392519 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b5d2835c-d426-4901-b1b8-e567acae31d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1238 microversion: 2.1 time: 0.091359 Sep 22 22:10:31.393094 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 45/82] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:31 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:31.906253 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-54aa8736-a77a-476e-94cb-8bcb894ddb96 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405dbdf670>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:31.986157 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-54aa8736-a77a-476e-94cb-8bcb894ddb96 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 200 len: 344 microversion: 2.1 time: 0.090567 Sep 22 22:10:31.990130 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 38/83] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:31 2022] GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:32.319333 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:32.319959 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:32.331621 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:32.337430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:32.338288 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:32.339924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:32.340573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:32.341228 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:32.369762 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:32.370407 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:32.378888 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:32.379291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:32.381905 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:32.383540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:32.388466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:32.388912 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:32.503232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:32.522017 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f9a1c6b8-172d-4ae5-8498-7db52d6552d0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1274 microversion: 2.1 time: 0.206563 Sep 22 22:10:32.522941 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 46/84] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:32 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:32.539896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:32.540529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:32.576575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:32.576575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:32.576575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:32.576575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:32.577027 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:32.577027 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:32.702378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:32.713188 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-adbaa85d-073d-4be3-ad20-3a65067e8669 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1238 microversion: 2.1 time: 0.186954 Sep 22 22:10:32.718168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 47/85] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:32 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1238 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:32.755013 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:32.764200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1526747d-3d01-463f-aecb-2aaa8cba6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.398772 Sep 22 22:10:32.764794 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 39/86] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:32 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:33.005385 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9aa8795a-a7c1-4c41-b083-2b1fb7af0341 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405cefd820>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:33.087644 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9aa8795a-a7c1-4c41-b083-2b1fb7af0341 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 200 len: 344 microversion: 2.1 time: 0.086434 Sep 22 22:10:33.088856 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 48/87] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:32 2022] GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:33.554685 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:33.555414 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:33.570057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:33.572225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:33.572816 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:33.574971 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:33.575513 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:33.577215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:33.707962 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:33.721849 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e7e03e66-5513-48ce-b70e-d115815274c1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1274 microversion: 2.1 time: 0.178135 Sep 22 22:10:33.729297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 40/88] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:33 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1274 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:33.743350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:33.743952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:33.752288 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:33.753146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:33.753840 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:33.754980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:33.755592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:33.756289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:33.791444 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:33.791444 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:33.802302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:33.802874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:33.803399 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:33.805222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:33.805769 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:33.807499 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:34.099837 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:34.118060 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1e263da9-bad0-4a61-ab8e-3d917cf11cea tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1238 microversion: 2.1 time: 0.379083 Sep 22 22:10:34.118962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 49/89] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:33 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1238 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:34.124225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4e736f14-7974-4d0d-9827-8ea56a70cfec tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405cefdc10>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:34.175997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-4e736f14-7974-4d0d-9827-8ea56a70cfec tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] HTTP exception thrown: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4e736f14-7974-4d0d-9827-8ea56a70cfec tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Request method failure captured: Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 HTTP/1.1 Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1BzxtYGhAqsM949V0ITHDoZg_BLgGXOlTy0WUp6CqWLcdvG3lQROQaBmYYQ17xQDRRwMlEZvx-V5-U9HvCwQxHhyD9pBdg0fWyIxAroaED3rD8fir089ULAHPa8C5dR8D7b8LGxJiU-EOPlqY5W3n2ZJ0jMKHeTmUL6dKeakE9xP4 Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 4e9bfc4da4e1421e94de0946e1e5251f Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:10:34.178345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e9bfc4da4e1421e94de0946e1e5251f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 4e9bfc4da4e1421e94de0946e1e5251f Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotsTestJSON-1999448492-project Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 067449d36a684dc6aa42f70f412817b4 Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1999448492-project Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'ed30b163-390a-4402-9e30-4c99893bf979'} Sep 22 22:10:34.180122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. (HTTP 404) (Request-ID: req-c5c5c121-4849-4de5-b17b-710864ef5f83) Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:34.181067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:34.182359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 22:10:34.183851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.185442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.187589 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4e736f14-7974-4d0d-9827-8ea56a70cfec tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Returning 404 to user: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:34.188643 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4e736f14-7974-4d0d-9827-8ea56a70cfec tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 404 len: 109 microversion: 2.1 time: 0.068786 Sep 22 22:10:34.189826 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 50/90] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:34 2022] GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:10:34.205792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0010fc91-e567-4dd5-83ea-02940c2280a4 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405cefd820>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:34.347447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-0010fc91-e567-4dd5-83ea-02940c2280a4 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] HTTP exception thrown: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0010fc91-e567-4dd5-83ea-02940c2280a4 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Request method failure captured: Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 HTTP/1.1 Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1BzxtYGhAqsM949V0ITHDoZg_BLgGXOlTy0WUp6CqWLcdvG3lQROQaBmYYQ17xQDRRwMlEZvx-V5-U9HvCwQxHhyD9pBdg0fWyIxAroaED3rD8fir089ULAHPa8C5dR8D7b8LGxJiU-EOPlqY5W3n2ZJ0jMKHeTmUL6dKeakE9xP4 Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 4e9bfc4da4e1421e94de0946e1e5251f Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:10:34.349859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e9bfc4da4e1421e94de0946e1e5251f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 4e9bfc4da4e1421e94de0946e1e5251f Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotsTestJSON-1999448492-project Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 067449d36a684dc6aa42f70f412817b4 Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1999448492-project Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'ed30b163-390a-4402-9e30-4c99893bf979'} Sep 22 22:10:34.351182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. (HTTP 404) (Request-ID: req-37c61d25-84f5-4187-bc88-76fc88cdf02b) Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:34.351992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 22:10:34.353404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 22:10:34.354509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0010fc91-e567-4dd5-83ea-02940c2280a4 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Returning 404 to user: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0010fc91-e567-4dd5-83ea-02940c2280a4 tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 404 len: 109 microversion: 2.1 time: 0.149702 Sep 22 22:10:34.356271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 51/91] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:10:34 2022] DELETE /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 22:10:34.364513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c065864e-2e47-423a-b780-6071c91c65bc tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Calling method '.version_select at 0x7f405cefd3a0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:34.414599 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:34.442466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0ccb258b-64d4-4002-9688-90480d46f3e3 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.657923 Sep 22 22:10:34.442954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 41/92] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:33 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:34.474800 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:34.673378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-c065864e-2e47-423a-b780-6071c91c65bc tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] HTTP exception thrown: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c065864e-2e47-423a-b780-6071c91c65bc tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Request method failure captured: Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 HTTP/1.1 Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1BzxtYGhAqsM949V0ITHDoZg_BLgGXOlTy0WUp6CqWLcdvG3lQROQaBmYYQ17xQDRRwMlEZvx-V5-U9HvCwQxHhyD9pBdg0fWyIxAroaED3rD8fir089ULAHPa8C5dR8D7b8LGxJiU-EOPlqY5W3n2ZJ0jMKHeTmUL6dKeakE9xP4 Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 4e9bfc4da4e1421e94de0946e1e5251f Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:10:34.676299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e9bfc4da4e1421e94de0946e1e5251f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e9bfc4da4e1421e94de0946e1e5251f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 4e9bfc4da4e1421e94de0946e1e5251f Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1999448492 Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotsTestJSON-1999448492-project Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 067449d36a684dc6aa42f70f412817b4 Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1999448492-project Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'ed30b163-390a-4402-9e30-4c99893bf979'} Sep 22 22:10:34.677926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. (HTTP 404) (Request-ID: req-a00a2b68-41ee-4507-b420-2708e98de366) Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:34.678765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 22:10:34.683427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 22:10:34.686187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c065864e-2e47-423a-b780-6071c91c65bc tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] Returning 404 to user: Volume ed30b163-390a-4402-9e30-4c99893bf979 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c065864e-2e47-423a-b780-6071c91c65bc tempest-VolumesSnapshotsTestJSON-1999448492 tempest-VolumesSnapshotsTestJSON-1999448492-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979" status: 404 len: 109 microversion: 2.1 time: 0.328601 Sep 22 22:10:34.691336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 52/93] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 22 22:10:34 2022] GET /compute/v2.1/os-volumes/ed30b163-390a-4402-9e30-4c99893bf979 => generated 109 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:10:34.753725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:34.754466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:34.771067 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:34.773359 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:34.774573 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:34.779801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:34.780379 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:34.784966 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:35.074138 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:35.087141 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d6756330-ab56-4f74-9a89-552f160292e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1274 microversion: 2.1 time: 0.338036 Sep 22 22:10:35.098364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 42/94] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:34 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1274 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:35.141756 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:35.143132 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:35.156214 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:35.156803 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:35.158772 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:35.159533 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:35.160001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:35.160433 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:35.282249 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:35.301967 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-aa13a757-8697-47c2-8ff0-fcbacd9865a8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1238 microversion: 2.1 time: 0.163640 Sep 22 22:10:35.303545 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 53/95] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:35 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1238 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:35.466218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=4 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:35.467011 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=14 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:35.471870 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:35.472623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:35.494086 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:35.494594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:35.497246 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:35.498927 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:35.500318 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:35.502087 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:36.064186 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:36.091288 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bec94d90-9720-4f4f-b5da-72808cf546ff tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.626944 Sep 22 22:10:36.094919 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 43/96] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:35 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:36.112541 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:36.113174 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:36.119945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=22 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:36.128681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:36.129236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:36.129751 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:36.130710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:36.142821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:36.144961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:36.330058 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:36.331235 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:36.369441 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:36.372552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:36.384561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:36.388518 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:36.394305 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:36.394899 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:36.793064 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:36.808418 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-af2e0116-aa88-426f-b50a-8c80507f5e0e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1274 microversion: 2.1 time: 0.699473 Sep 22 22:10:36.823794 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 54/97] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:36 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1274 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:36.861015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:36.885521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4dc0b294-37b7-4e3a-95fc-78240db1080f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1294 microversion: 2.1 time: 0.559565 Sep 22 22:10:36.897873 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 44/98] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:36 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1294 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:37.128174 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:37.136517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:37.155788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:37.156607 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:37.156836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:37.160109 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:37.160595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:37.166274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:37.832209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:37.832825 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:37.844467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:37.845393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:37.846160 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:37.847162 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:37.872978 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:37.876012 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:38.101480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:38.106613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:38.116936 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-001751bd-a537-4bdd-b89f-b21438c22237 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1280 microversion: 2.1 time: 0.290434 Sep 22 22:10:38.121922 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 45/99] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:37 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1280 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:38.152688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:38.162677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-60f3640a-e324-435a-ae36-b1fd3db02ff2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 1.043317 Sep 22 22:10:38.165249 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 55/100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:37 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:38.171691 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:38.173179 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:38.180206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:38.181129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:38.182225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:38.183571 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:38.184288 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:38.185093 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:38.329674 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:38.340936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-157ae239-7331-457e-9a3f-2cef68e3d1d1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1294 microversion: 2.1 time: 0.174274 Sep 22 22:10:38.357135 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 56/101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:38 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1294 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:38.618612 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-651a5e93-55f6-4acb-af52-5102e5431422 req-1ea90771-b3c2-4ae5-9a78-10a7b95a98ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1", "tag": "ff7ff287-6c46-404f-8342-e27e96b08606"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:38.693424 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-651a5e93-55f6-4acb-af52-5102e5431422 req-1ea90771-b3c2-4ae5-9a78-10a7b95a98ff service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:38.696033 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-651a5e93-55f6-4acb-af52-5102e5431422 req-1ea90771-b3c2-4ae5-9a78-10a7b95a98ff service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:38.698420 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-651a5e93-55f6-4acb-af52-5102e5431422 req-1ea90771-b3c2-4ae5-9a78-10a7b95a98ff service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:38.817846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-651a5e93-55f6-4acb-af52-5102e5431422 req-1ea90771-b3c2-4ae5-9a78-10a7b95a98ff service nova] Creating event network-changed:ff7ff287-6c46-404f-8342-e27e96b08606 for instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 on hv-cinder-84914 Sep 22 22:10:38.819021 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-651a5e93-55f6-4acb-af52-5102e5431422 req-1ea90771-b3c2-4ae5-9a78-10a7b95a98ff service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120662) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 22 22:10:38.820529 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-651a5e93-55f6-4acb-af52-5102e5431422 req-1ea90771-b3c2-4ae5-9a78-10a7b95a98ff service nova] Acquired lock "compute-rpcapi-router" {{(pid=120662) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 22 22:10:38.827602 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2349d0e1-a811-4d8c-9ea0-586d75e59381 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:38.833580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2349d0e1-a811-4d8c-9ea0-586d75e59381 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:38.837295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2349d0e1-a811-4d8c-9ea0-586d75e59381 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:38.840124 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2349d0e1-a811-4d8c-9ea0-586d75e59381 None None] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:38.842256 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2349d0e1-a811-4d8c-9ea0-586d75e59381 None None] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:38.846059 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2349d0e1-a811-4d8c-9ea0-586d75e59381 None None] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:38.901626 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.compute.rpcapi [None req-2349d0e1-a811-4d8c-9ea0-586d75e59381 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 22 22:10:38.908606 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2349d0e1-a811-4d8c-9ea0-586d75e59381 None None] Releasing lock "compute-rpcapi-router" {{(pid=120662) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 22 22:10:38.960877 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2349d0e1-a811-4d8c-9ea0-586d75e59381 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.836701 Sep 22 22:10:38.962442 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 46/102] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:39.151754 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:39.153064 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:39.161437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:39.161929 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:39.162467 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:39.164353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:39.166266 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:39.167495 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:39.205097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:39.206795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:39.224852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:39.226848 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:39.228145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:39.232442 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:39.233628 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:39.234473 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:40.017225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:40.043514 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-df5c2c8f-a670-4452-92f9-0319770a0f02 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.843247 Sep 22 22:10:40.064766 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 47/103] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:39 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:40.078807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:40.079374 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:40.107367 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:40.108333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:40.109000 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:40.109840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:40.127102 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:40.127566 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:40.190702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:40.210951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e007c9ef-2ae0-4993-98e0-03ab6facdea2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 1.054497 Sep 22 22:10:40.223676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 57/104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:39 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:40.554600 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:40.591741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2ee56006-eb1f-45a8-bc1c-8ee2d84a6d95 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1300 microversion: 2.1 time: 0.514056 Sep 22 22:10:40.594040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 48/105] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:40 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1300 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:41.075290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:41.076214 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:41.086996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:41.087847 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:41.090575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:41.091563 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:41.092212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:41.097384 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:41.227124 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:41.228944 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:41.252814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:41.253960 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:41.257838 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:41.260092 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:41.265350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:41.266452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:42.408207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:42.420371 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b0fb6301-17a3-47d1-89e2-d395a05f628f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 1.197474 Sep 22 22:10:42.424878 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 49/106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:41 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:42.437467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:42.437467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:42.454233 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:42.456464 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:42.457173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:42.458599 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:42.461945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:42.462426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:42.512764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:42.516929 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:42.531065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5fa2782e-8e84-4f09-97f8-98a74a7d1eb9 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 1.462191 Sep 22 22:10:42.531803 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 58/107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:41 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:42.536753 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-f04fc778-3f59-432b-94de-8eed5fb6a72d req-32e79e6d-ab82-4094-a110-3dc2de39a4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4", "tag": "9fd347ea-72b4-4b9b-97b6-c703e8d2774a"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:42.570764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f04fc778-3f59-432b-94de-8eed5fb6a72d req-32e79e6d-ab82-4094-a110-3dc2de39a4cb service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:42.571223 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f04fc778-3f59-432b-94de-8eed5fb6a72d req-32e79e6d-ab82-4094-a110-3dc2de39a4cb service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:42.571987 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f04fc778-3f59-432b-94de-8eed5fb6a72d req-32e79e6d-ab82-4094-a110-3dc2de39a4cb service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:42.600198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-f04fc778-3f59-432b-94de-8eed5fb6a72d req-32e79e6d-ab82-4094-a110-3dc2de39a4cb service nova] Creating event network-changed:9fd347ea-72b4-4b9b-97b6-c703e8d2774a for instance e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 on hv-cinder-84914 Sep 22 22:10:42.600834 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f04fc778-3f59-432b-94de-8eed5fb6a72d req-32e79e6d-ab82-4094-a110-3dc2de39a4cb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 22 22:10:42.601350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-f04fc778-3f59-432b-94de-8eed5fb6a72d req-32e79e6d-ab82-4094-a110-3dc2de39a4cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=120663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 22 22:10:42.602484 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fbb29d37-94b7-4724-ba47-d83bacc22ca7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:42.603352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fbb29d37-94b7-4724-ba47-d83bacc22ca7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:42.604088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fbb29d37-94b7-4724-ba47-d83bacc22ca7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:42.605705 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fbb29d37-94b7-4724-ba47-d83bacc22ca7 None None] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:42.606933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fbb29d37-94b7-4724-ba47-d83bacc22ca7 None None] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:42.607529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fbb29d37-94b7-4724-ba47-d83bacc22ca7 None None] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:42.618351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.compute.rpcapi [None req-fbb29d37-94b7-4724-ba47-d83bacc22ca7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 22 22:10:42.619419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fbb29d37-94b7-4724-ba47-d83bacc22ca7 None None] Releasing lock "compute-rpcapi-router" {{(pid=120663) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 22 22:10:42.637994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fbb29d37-94b7-4724-ba47-d83bacc22ca7 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104512 Sep 22 22:10:42.638712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 59/108] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:42.873032 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:42.881415 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-df4df40a-2c76-486c-be10-3c50a110c603 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.455367 Sep 22 22:10:42.882004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 50/109] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:42 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:43.456551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:43.457818 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:43.488307 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:43.490897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:43.492543 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:43.493485 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:43.495718 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:43.498783 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:43.554440 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:43.555852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:43.565757 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:43.566625 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:43.567358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:43.568260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:43.569039 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:43.569619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:44.164452 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:44.179006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2de6ec96-8ddc-45e2-8a9a-4a645ebbea11 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.723595 Sep 22 22:10:44.193514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 60/110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:43 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:44.201043 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:44.201896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:44.208633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:44.209340 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:44.209918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:44.210748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:44.219050 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:44.219501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:44.231761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:44.241899 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f69121ba-1ac3-4c02-9605-9fe67a11163d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.691376 Sep 22 22:10:44.264186 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 51/111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:43 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:44.815709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:44.827110 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2fd9895f-6672-4200-821f-72e747102214 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.631296 Sep 22 22:10:44.828520 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 61/112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:44 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:45.210744 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:45.210744 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:45.241408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:45.244088 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:45.245916 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:45.249003 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:45.253516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:45.254204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:45.285757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:45.286560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:45.299271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:45.300090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:45.301368 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:45.302183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:45.302808 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:45.303431 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:45.815670 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:45.828493 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-15e124bc-3be5-4939-970e-504e4b899f7a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.625133 Sep 22 22:10:45.834928 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:45.846812 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 52/113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:45 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:45.848344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f1eabf76-c1fe-4e0d-b2e8-e6d648da7028 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.571167 Sep 22 22:10:45.849423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 62/114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:45 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:45.852945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:45.854251 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:45.873284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:45.873997 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:45.875601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:45.876507 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:45.878256 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:45.881646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:46.347444 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:46.367418 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0096a857-6e84-4750-b7ab-577b198c3443 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.517155 Sep 22 22:10:46.370241 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 53/115] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:45 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:46.851856 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:46.852820 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:46.863050 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:46.863527 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:46.863964 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:46.864842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:46.871839 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:46.872377 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:46.919141 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-3b72fe97-5b8a-425a-b50f-0a2a26baa452 req-29e6d45f-b999-4104-abae-2385d54743fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b462de-3ef3-4c76-bf6c-f1ce9edcda5b", "tag": "8663b072-db48-4fbd-b30f-98d4794fd966"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:46.928691 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3b72fe97-5b8a-425a-b50f-0a2a26baa452 req-29e6d45f-b999-4104-abae-2385d54743fc service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:46.929448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3b72fe97-5b8a-425a-b50f-0a2a26baa452 req-29e6d45f-b999-4104-abae-2385d54743fc service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:46.930063 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3b72fe97-5b8a-425a-b50f-0a2a26baa452 req-29e6d45f-b999-4104-abae-2385d54743fc service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:46.942286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-3b72fe97-5b8a-425a-b50f-0a2a26baa452 req-29e6d45f-b999-4104-abae-2385d54743fc service nova] Creating event network-changed:8663b072-db48-4fbd-b30f-98d4794fd966 for instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b on hv-cinder-84914 Sep 22 22:10:46.947440 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-3b72fe97-5b8a-425a-b50f-0a2a26baa452 req-29e6d45f-b999-4104-abae-2385d54743fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181775 Sep 22 22:10:46.948807 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 63/116] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:46.954188 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:46.954897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:46.957909 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:46.961469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:46.961955 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:46.962380 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:46.963342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:46.964042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:46.964471 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:47.093615 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:47.102006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4d355096-1467-4a8c-b1a4-d2b53385afa8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.253964 Sep 22 22:10:47.102591 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 54/117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:46 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:47.148399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:47.156720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9ae02b0c-dd59-4dfc-b583-71f971d20a2a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.206519 Sep 22 22:10:47.157460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 64/118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:46 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:47.395267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:47.395267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:47.399379 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:47.399850 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:47.400273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:47.401519 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:47.402010 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:47.402426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:47.551878 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:47.562235 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bec36de4-79f7-4cac-8cd9-0ed4772a070b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.173778 Sep 22 22:10:47.562818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 55/119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:47 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:48.129146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:48.129892 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:48.138260 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:48.139108 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:48.139760 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:48.140613 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:48.141248 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:48.141675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:48.182614 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:48.183414 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:48.189624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:48.190351 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:48.190849 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:48.191537 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:48.191981 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:48.192399 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:48.335503 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:48.343871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24a4eceb-45b8-4897-adb2-edbdc652858e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.220730 Sep 22 22:10:48.344714 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 65/120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:48 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:48.369169 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:48.377599 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-063fdc79-6f02-46c6-8e03-03e9cf1ab66e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.199692 Sep 22 22:10:48.378170 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 56/121] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:48 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:48.584962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:48.585606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:48.592219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:48.592710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:48.593361 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:48.594058 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:48.594516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:48.594954 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:48.734625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:48.742352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7fc327f4-2d8a-464d-a04b-c8986c0f35bd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.161230 Sep 22 22:10:48.746393 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 66/122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:48 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:48.966929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-ef63349c-3545-4d74-8870-9fdb258799f8 req-4f5d0411-d5de-49e4-b501-5dcc46814469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "765e0b40-b687-4b25-b264-0b84e9d0a8a3", "tag": "1f73d7aa-997f-4856-81f0-98fb975bdbf8"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:10:48.971795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:48.977992 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ef63349c-3545-4d74-8870-9fdb258799f8 req-4f5d0411-d5de-49e4-b501-5dcc46814469 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:48.982187 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ef63349c-3545-4d74-8870-9fdb258799f8 req-4f5d0411-d5de-49e4-b501-5dcc46814469 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:48.982187 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ef63349c-3545-4d74-8870-9fdb258799f8 req-4f5d0411-d5de-49e4-b501-5dcc46814469 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:48.993464 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-ef63349c-3545-4d74-8870-9fdb258799f8 req-4f5d0411-d5de-49e4-b501-5dcc46814469 service nova] Creating event network-changed:1f73d7aa-997f-4856-81f0-98fb975bdbf8 for instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 on hv-cinder-84914 Sep 22 22:10:48.999072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-ef63349c-3545-4d74-8870-9fdb258799f8 req-4f5d0411-d5de-49e4-b501-5dcc46814469 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036049 Sep 22 22:10:48.999887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 57/123] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:10:49.368198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:49.368802 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:49.375166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:49.375608 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:49.376301 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:49.377027 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:49.377532 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:49.377950 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:49.401259 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:49.401951 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:49.412752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:49.413735 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:49.414279 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:49.415009 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:49.415459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:49.415875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:49.616359 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:49.626462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b7560336-76d4-46ac-a41b-d1961c4b36be tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.229488 Sep 22 22:10:49.636884 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 58/124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:49 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:49.644954 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:49.654623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-540a3e21-837f-4bc2-abb0-adeeb93f0490 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.290594 Sep 22 22:10:49.655288 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 67/125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:49 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:49.767494 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:49.768103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:49.774920 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:49.775562 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:49.776368 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:49.777658 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:49.778066 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:49.778644 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:49.943587 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:49.953491 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-573d9f11-9d00-44bd-9614-20ce2e7df28d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.190145 Sep 22 22:10:49.970121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 59/126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:49 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:50.652237 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:50.653648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:50.662202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:50.663056 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:50.663842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:50.664839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:50.665775 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:50.666609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:50.679886 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:50.682658 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:50.686584 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:50.694781 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:50.698072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:50.699154 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:50.700363 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:50.705385 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:50.707004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:51.795501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:51.805397 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c0c980c7-91ed-4dad-a8d3-14be0e8ae107 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 1.158919 Sep 22 22:10:51.806230 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 68/127] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:50 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:51.810979 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:51.811582 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:51.819262 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:51.819746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:51.820201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:51.821072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:51.821545 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:51.821959 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:51.883962 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:51.893384 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3d581210-3761-4ea9-adca-6dab368674e6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 1.218144 Sep 22 22:10:51.894077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 60/128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:50 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:52.319871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:52.332440 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dbe3dca3-2b85-4a2c-8624-7b020084f316 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.525120 Sep 22 22:10:52.333258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 69/129] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:51 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:52.831541 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:52.832203 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:52.842651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:52.843404 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:52.844047 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:52.844845 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:52.847309 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:52.847945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:52.920951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:52.921653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:52.928186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:52.930294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:52.931868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:52.932474 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:52.933370 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:52.933825 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:52.934254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:53.191726 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:53.217799 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:53.222686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ad370ce7-a65f-4df4-9246-fbcae63aa723 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.395011 Sep 22 22:10:53.225441 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 61/130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:52 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:53.230141 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0a996e48-d548-4409-abf9-50ef3b36c157 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.314017 Sep 22 22:10:53.230710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 70/131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:52 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:53.359422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:53.360728 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:53.371032 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:53.372101 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:53.373375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:53.376340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:53.377042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:53.379709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:53.620327 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:53.630651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-421ca275-0743-4d4b-a2e5-0e075d5c0958 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.276430 Sep 22 22:10:53.631331 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 62/132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:53 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:54.256601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:54.260733 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:54.260960 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:54.262580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:54.274836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:54.278298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:54.278549 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:54.279804 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:54.280065 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:54.281878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:54.282126 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:54.283156 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:54.283825 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:54.284913 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:54.285254 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:54.285741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:54.314226 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:54.527632 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:54.527729 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:54.530121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9fd0eff9-25c6-4f62-b6cf-3c73e516320a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.280106 Sep 22 22:10:54.530811 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d7a904d1-587e-41e6-80c8-ea61068809cb tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.283954 Sep 22 22:10:54.541150 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 63/133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:54 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:54.544168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 71/134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:54 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:54.655268 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:54.655885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:54.661966 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:54.662450 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:54.663055 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:54.663749 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:54.664205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:54.664637 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:54.808364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:54.818910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7437bdc6-1fda-4e02-87ed-e79f0c74db94 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.167591 Sep 22 22:10:54.819494 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 64/135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:54 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:55.557563 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:55.559892 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:55.567906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:55.568547 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:55.568547 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:55.568732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:55.568888 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:55.569795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:55.571982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:55.572611 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:55.574707 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:55.575482 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:55.575916 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:55.576718 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:55.577049 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:55.577652 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:55.788456 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:55.792573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:55.800730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-755bc33a-2065-4093-93cc-90e459379246 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.249980 Sep 22 22:10:55.801392 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 72/136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:55 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:55.808825 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d33e4211-f087-4f48-ab6e-0826ac4ae426 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.246831 Sep 22 22:10:55.809385 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 65/137] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:55 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:55.842127 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:55.842733 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:55.848459 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:55.848972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:55.849484 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:55.850173 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:55.850627 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:55.851660 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:55.994099 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:56.002631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f091982f-2402-459b-923d-a3f3a1cc71d2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.164320 Sep 22 22:10:56.003253 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 73/138] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:55 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:56.825942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:56.825942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:56.831610 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:56.832093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:56.832233 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:56.832657 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:56.832863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:56.833222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:56.833807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:56.834420 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:56.840953 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:56.841521 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:56.842193 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:56.842986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:56.843583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:56.844145 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:57.208611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:57.217071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:57.217422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bb3cdf54-ea86-4766-a90c-6775f9c60413 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.397336 Sep 22 22:10:57.218175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 66/139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:56 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:57.223433 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:57.224241 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:57.225507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-38cb8b97-02b9-4bfe-84d6-c16d3edd2551 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.397163 Sep 22 22:10:57.226154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 74/140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:56 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:57.231676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:57.232154 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:57.232582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:57.233294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:57.233885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:57.234430 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:57.415334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:57.424283 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fd54372e-c44a-4e04-9c3d-1b0de8292057 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.204719 Sep 22 22:10:57.424906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 67/141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:57 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:58.244970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:58.245606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:58.253427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:58.254103 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:58.254840 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:58.255959 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:58.256423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:58.256798 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:58.257270 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:58.258334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:58.265977 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:58.266582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:58.267243 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:58.268145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:58.268709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:58.269273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:58.458254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:58.469236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cc6effd1-25fd-4295-abe0-27eb67547098 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.228467 Sep 22 22:10:58.469850 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 75/142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:58 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:58.474414 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:58.475039 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:58.481145 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:58.481716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:58.482153 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:58.482840 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:58.483072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:58.483294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:58.483716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:58.495842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-80361116-1d0d-487b-9567-fbdaec9ae67e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.244793 Sep 22 22:10:58.496711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 68/143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:58 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:10:58.503462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:10:58.617183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:58.626263 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-89cffaad-4f20-4f49-b519-6722ce33f643 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.155444 Sep 22 22:10:58.626917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 76/144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:58 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:59.494772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:59.495909 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:59.501560 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:59.502035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:59.502479 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:59.503133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:59.503583 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:59.503998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:59.519644 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:59.520903 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:59.528785 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:59.529541 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:59.530156 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:59.531007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:59.531471 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:59.531891 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:59.713538 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:59.716952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:59.722283 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-389f436e-91c7-49dc-b63f-16032981e7b8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.231332 Sep 22 22:10:59.722944 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 69/145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:59 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:59.725716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-86001f10-f33b-4315-b95c-24d983368f22 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.209633 Sep 22 22:10:59.726419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 77/146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:59 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:10:59.728492 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:10:59.729589 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:10:59.735738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:59.736407 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:59.738716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:59.739450 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:10:59.739919 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:10:59.740344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:10:59.886898 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:10:59.894542 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a3d30575-1f9c-4c00-bef9-037d24770ea3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.170475 Sep 22 22:10:59.895115 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 70/147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:10:59 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:00.745748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:00.746378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:00.754292 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:00.754790 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:00.755043 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:00.755450 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:00.756081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:00.756207 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:00.756566 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:00.756988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:00.766100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:00.767077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:00.767774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:00.768903 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:00.788567 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:00.789637 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:00.992113 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:00.996226 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:00.999988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-918dd9de-025c-4c15-a517-245ecda34aaa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.258244 Sep 22 22:11:01.000646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 78/148] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:00 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:01.005138 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:01.005838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:01.006791 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-55326584-863e-442c-ba78-7eb04b245adf tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.257360 Sep 22 22:11:01.015779 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 71/149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:00 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:01.015948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:01.015948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:01.015948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:01.015948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:01.016218 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:01.016218 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:01.146673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:01.154346 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-76e5cdce-17d9-42a5-8e04-14c09e151ba5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.152645 Sep 22 22:11:01.155650 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 79/150] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:01 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:01.731970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-2ef377d2-bec6-40b6-aaa8-f300cdffdc66 req-8dfbe45f-9492-46d6-9b77-dc8fadc6a1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1", "name": "network-vif-plugged", "status": "completed", "tag": "ff7ff287-6c46-404f-8342-e27e96b08606"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:11:01.741540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2ef377d2-bec6-40b6-aaa8-f300cdffdc66 req-8dfbe45f-9492-46d6-9b77-dc8fadc6a1c5 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:01.742005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2ef377d2-bec6-40b6-aaa8-f300cdffdc66 req-8dfbe45f-9492-46d6-9b77-dc8fadc6a1c5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:01.742422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2ef377d2-bec6-40b6-aaa8-f300cdffdc66 req-8dfbe45f-9492-46d6-9b77-dc8fadc6a1c5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:01.754375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-2ef377d2-bec6-40b6-aaa8-f300cdffdc66 req-8dfbe45f-9492-46d6-9b77-dc8fadc6a1c5 service nova] Creating event network-vif-plugged:ff7ff287-6c46-404f-8342-e27e96b08606 for instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 on hv-cinder-84914 Sep 22 22:11:01.759590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-2ef377d2-bec6-40b6-aaa8-f300cdffdc66 req-8dfbe45f-9492-46d6-9b77-dc8fadc6a1c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085186 Sep 22 22:11:01.760156 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 72/151] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:11:02.023715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:02.025725 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:02.033053 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:02.033570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:02.033695 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:02.034004 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:02.034285 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:02.034709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:02.035158 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:02.035769 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:02.042791 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:02.043375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:02.043871 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:02.044687 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:02.045488 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:02.046042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:02.241512 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:02.249391 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7d96e483-2051-4f81-83e0-5488b3f345f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.229801 Sep 22 22:11:02.249969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 80/152] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:02 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:02.254645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:02.257712 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:02.260429 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:02.266387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cce47fe2-c671-4a55-9ac6-ce04ddade161 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.238239 Sep 22 22:11:02.266588 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:02.266963 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 73/153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:02 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:02.267091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:02.267475 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:02.268158 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:02.268600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:02.269013 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:02.403660 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:02.411163 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-adfc21a1-8d11-40a1-b8ab-588d74f0b148 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.160270 Sep 22 22:11:02.411738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 81/154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:02 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:03.272774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:03.273512 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:03.279497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:03.279975 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:03.280410 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:03.281092 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:03.281569 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:03.281989 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:03.290872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:03.291815 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:03.298336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:03.298897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:03.299420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:03.300186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:03.300651 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:03.301075 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:03.481059 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:03.484661 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:03.488944 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d917b8c9-8353-4a71-ad3a-0724c0b9e58b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.220003 Sep 22 22:11:03.489580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 74/155] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:03 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:03.492825 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7d176028-af52-4c37-95a9-bec1517333c7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.206697 Sep 22 22:11:03.493648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 82/156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:03 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:03.495642 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:03.496322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:03.502359 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:03.502914 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:03.503451 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:03.504247 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:03.504706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:03.505148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:03.630893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:03.638560 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-85399f0a-8ada-4a7e-808e-71096358d1c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.148035 Sep 22 22:11:03.639137 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 75/157] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:03 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:04.512220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:04.512928 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:04.515109 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:04.515717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:04.519028 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:04.519508 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:04.519936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:04.520614 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:04.521063 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:04.521495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:04.521591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:04.521969 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:04.522396 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:04.523069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:04.523512 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:04.523928 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:04.711200 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:04.717813 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:04.719009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c3a6e735-bdf9-4bdc-b959-7b7d765c0c2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.211286 Sep 22 22:11:04.719810 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 83/158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:04 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:04.723998 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:04.724576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:04.725590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-98117ca1-4fff-46ef-b868-9d635ee55e3c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.214219 Sep 22 22:11:04.726139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 76/159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:04 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:04.731065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:04.731652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:04.732212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:04.732990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:04.733575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:04.734089 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:04.863264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:04.871408 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11bf4632-4ea3-4af5-b4f2-bbef996c7634 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.150873 Sep 22 22:11:04.871973 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 84/160] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:04 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:05.742522 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:05.743754 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:05.748076 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:05.748676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:05.749724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:05.750205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:05.750628 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:05.751309 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:05.751751 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:05.752161 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:05.754532 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:05.755009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:05.755434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:05.756107 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:05.756551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:05.756963 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:05.947798 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:05.952038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:05.955451 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-394fca08-d327-485c-a20c-285670689e36 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.216786 Sep 22 22:11:05.956015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 77/161] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:05 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:05.959894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9acd3d20-5ad0-4eb4-a827-7894d7dde5da tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.215544 Sep 22 22:11:05.960542 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:05.960677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 85/162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:05 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:05.961237 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:05.967366 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:05.967839 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:05.968270 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:05.968937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:05.969490 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:05.969814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:06.314554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:06.325688 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c673596f-e20f-47a0-b80b-af50eebfaaed tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.368650 Sep 22 22:11:06.326269 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 78/163] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:05 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:06.979062 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:06.979789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:06.983452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:06.984055 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:06.985817 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:06.986304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:06.986738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:06.987462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:06.987918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:06.988622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:06.989760 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:06.990230 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:06.990665 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:06.991507 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:06.991955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:06.993859 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:07.191429 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:07.197577 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:07.200370 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4a3f51c2-36b7-4003-8e3e-492062b38e07 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.225387 Sep 22 22:11:07.201731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 86/164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:06 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:07.205362 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9aabd651-241c-49e9-9395-ca852e14b019 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.225735 Sep 22 22:11:07.205925 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 79/165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:06 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:07.349073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:07.350060 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:07.356822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:07.357391 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:07.357939 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:07.358752 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:07.359329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:07.359717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:07.497473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:07.505628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a800c55d-157b-4fb7-983b-5dc8453624ce tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.161829 Sep 22 22:11:07.506183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 87/166] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:07 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:08.224014 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:08.224589 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:08.229023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:08.230488 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:08.236463 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:08.236955 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:08.237417 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:08.238276 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:08.238933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:08.239563 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:08.243923 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:08.244424 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:08.244851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:08.245595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:08.246041 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:08.246453 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:08.440528 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:08.443515 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:08.447686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:08.449468 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0dcc4218-706d-4b61-9c88-88af43c31e92 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.225414 Sep 22 22:11:08.450078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 88/167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:08 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:08.452803 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7df6fbca-1716-43e0-ab17-9a59ab474d48 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.233010 Sep 22 22:11:08.453401 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 80/168] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:08 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:08.529672 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:08.530283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:08.536099 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:08.536580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:08.537018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:08.537726 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:08.538180 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:08.538600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:08.665600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:08.672984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-253a5328-f659-438f-8a89-7ac87f9ba712 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.147179 Sep 22 22:11:08.673571 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 89/169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:08 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:09.474004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:09.474381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:09.475624 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:09.476698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:09.480915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:09.481450 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:09.481880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:09.482571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:09.483019 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:09.483434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:09.483526 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:09.483968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:09.484395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:09.485074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:09.485548 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:09.485959 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:09.842445 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:09.846509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:09.850036 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d238e2d7-dfcf-478d-b6e9-16685f28d2c5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.380677 Sep 22 22:11:09.850596 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 81/170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:09 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:09.854582 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-aa455aad-dd86-4100-9178-f68f8b9cbbfc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.382658 Sep 22 22:11:09.855136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 90/171] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:09 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:09.855258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:09.855851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:09.861969 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:09.862456 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:09.862891 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:09.863572 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:09.864022 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:09.864436 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:09.993533 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:10.001173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e47abe6d-7ac5-4691-ab52-5b5fc4ea3c26 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.149399 Sep 22 22:11:10.001747 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 82/172] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:09 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:10.873637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:10.874353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:10.877148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:10.877752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:10.880523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:10.881004 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:10.881501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:10.882200 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:10.882649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:10.883059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:10.883974 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:10.884496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:10.884930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:10.885642 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:10.886123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:10.886540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:11.073594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:11.078026 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:11.081375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-136c45e5-7c8b-4191-ac88-0623cffc7474 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.207878 Sep 22 22:11:11.081942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 83/173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:10 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:11.085764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-35896ff3-9c61-4b9b-89ee-26cabe2aff60 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.216039 Sep 22 22:11:11.086413 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 91/174] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:10 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:11.094976 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:11.094976 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:11.094976 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:11.094976 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:11.095300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:11.095300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:11.095300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:11.095300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:11.221004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:11.228786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6cc52c74-9646-424c-b3b4-17e751989077 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.145738 Sep 22 22:11:11.229392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 84/175] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:11 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:12.103940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:12.104543 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:12.108046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:12.108656 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:12.110932 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:12.111416 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:12.111848 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:12.112530 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:12.112980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:12.113429 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:12.114408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:12.114894 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:12.115333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:12.116027 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:12.116479 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:12.116901 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:12.306236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:12.309434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:12.314030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e433df9c-e2eb-46dc-bef9-15e1a9618d30 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.214114 Sep 22 22:11:12.314600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 92/176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:12 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:12.319030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:12.319628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:12.323942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c75efde0-7075-491f-a42c-24fe3f0bd266 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.219632 Sep 22 22:11:12.324780 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 85/177] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:12 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:12.325958 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:12.326440 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:12.326874 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:12.327556 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:12.328005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:12.328423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:12.332360 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:12.460286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:12.469807 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0dfd3f64-38f1-4a28-bfc4-cbbffb2de245 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.154210 Sep 22 22:11:12.470378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 93/178] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:12 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:13.337278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:13.337805 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:13.343841 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:13.344333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:13.344759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:13.345473 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:13.345928 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:13.346349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:13.347684 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:13.348309 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:13.354552 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:13.355030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:13.355457 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:13.356135 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:13.356580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:13.356994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:13.536123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:13.549978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:13.551953 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-98645584-af45-40bc-9d8f-5b5b5ce2f538 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.218529 Sep 22 22:11:13.560006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 86/179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:13 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:13.560006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:13.560006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:13.564103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:13.564589 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:13.565016 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:13.565716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:13.566161 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:13.566509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a2ec2c21-1dc0-4d6f-af83-503388775f9e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.222414 Sep 22 22:11:13.566613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:13.567692 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 94/180] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:13 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:13.700435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:13.707890 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b91179ba-d6f6-4261-ab6b-228cafa4204e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.154390 Sep 22 22:11:13.708442 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 87/181] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:13 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:14.576196 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:14.576907 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:14.582852 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:14.583324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:14.583749 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:14.584435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:14.584881 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:14.585328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:14.590167 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:14.590778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:14.596550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:14.597032 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:14.597502 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:14.598192 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:14.598651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:14.599073 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:14.775985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:14.783542 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bae6dd04-058a-4f2f-998a-b0f0b244c78b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.211071 Sep 22 22:11:14.784787 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 95/182] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:14 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:14.786465 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:14.789376 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:14.790208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:14.794607 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-94a2d951-37a7-4c7d-ba99-30b09d889ade tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.209080 Sep 22 22:11:14.800176 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 88/183] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:14 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:14.800338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:14.800338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:14.800338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:14.800338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:14.800682 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:14.800682 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:14.932560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:14.940245 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-56285898-9ead-468f-8061-b1c5e9a3a2a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.154460 Sep 22 22:11:14.940804 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 96/184] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:14 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:15.807068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:15.807675 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:15.813728 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:15.814207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:15.814641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:15.815319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:15.815768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:15.816183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:15.817296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:15.817902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:15.824459 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:15.824932 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:15.825390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:15.826068 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:15.826520 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:15.826933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:16.008413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:16.016016 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7758f38c-446a-4003-bbc3-73725314632f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.213115 Sep 22 22:11:16.016582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 89/185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:15 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:16.020935 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:16.021553 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:16.025742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:16.027994 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:16.028475 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:16.028903 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:16.029807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:16.030260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:16.030682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:16.033860 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ade4976d-8bac-48e6-8e37-21bb7ca76a7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.220387 Sep 22 22:11:16.034621 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 97/186] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:15 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:16.162217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:16.170028 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-34b2684f-5977-474a-864f-75a90626e971 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.152451 Sep 22 22:11:16.170603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 90/187] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:16 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:16.647254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-caa46387-40a8-4b1b-b035-1a6fe6789262 req-a19723ad-634f-497c-96a5-0e10c0f2a071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4", "name": "network-vif-plugged", "status": "completed", "tag": "9fd347ea-72b4-4b9b-97b6-c703e8d2774a"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:11:16.658013 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-caa46387-40a8-4b1b-b035-1a6fe6789262 req-a19723ad-634f-497c-96a5-0e10c0f2a071 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:16.658617 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-caa46387-40a8-4b1b-b035-1a6fe6789262 req-a19723ad-634f-497c-96a5-0e10c0f2a071 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:16.659046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-caa46387-40a8-4b1b-b035-1a6fe6789262 req-a19723ad-634f-497c-96a5-0e10c0f2a071 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:16.671136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-caa46387-40a8-4b1b-b035-1a6fe6789262 req-a19723ad-634f-497c-96a5-0e10c0f2a071 service nova] Creating event network-vif-plugged:9fd347ea-72b4-4b9b-97b6-c703e8d2774a for instance e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 on hv-cinder-84914 Sep 22 22:11:16.676580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-caa46387-40a8-4b1b-b035-1a6fe6789262 req-a19723ad-634f-497c-96a5-0e10c0f2a071 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032888 Sep 22 22:11:16.677398 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 98/188] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:11:17.041378 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:17.041378 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:17.046156 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:17.046634 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:17.047061 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:17.047738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:17.048196 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:17.048640 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:17.058548 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:17.059335 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:17.061203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=69 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:17.071896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:17.072838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:17.073436 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:17.074438 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:17.075066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:17.075855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:17.246864 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:17.253572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:17.254469 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e63322a2-0e90-44ec-b1ec-53ad44fd389e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.220134 Sep 22 22:11:17.255036 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 91/189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:17 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:17.260182 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:17.260776 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:17.261918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3a77211c-bd44-46d4-9afb-6a8fc7864a71 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.209345 Sep 22 22:11:17.262648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 99/190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:17 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:17.266508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:17.266987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:17.267412 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:17.268088 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:17.268699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:17.269150 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:17.398205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:17.407518 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-affd2802-3c40-431a-b26c-5477712aab98 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.151229 Sep 22 22:11:17.408324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 92/191] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:17 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:17.846011 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-830084833", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "networks": [{"uuid": "ade89f04-fe3a-455d-93a5-b71450428421"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:11:17.905002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] validate_networks() for [('ade89f04-fe3a-455d-93a5-b71450428421', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:11:18.277884 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:18.278499 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:18.291044 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:18.291779 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:18.292405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:18.293289 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:18.294100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:18.294892 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:18.401562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:11:18.402024 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:11:18.402445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:11:18.402857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:11:18.403265 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:11:18.412692 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:18.413266 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:18.413703 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:18.415413 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:18.415913 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:18.416340 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:18.434594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Getting quotas for project d58361c0e40c48f4966aee3515859326. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:11:18.438754 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Getting quotas for user cd913a3c0cff4787a90603f3afb2e883 and project d58361c0e40c48f4966aee3515859326. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:11:18.451101 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:11:18.453421 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:11:18.465726 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:18.473892 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9d14a5d0-48d1-4579-adac-b4e719c34ca8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.199816 Sep 22 22:11:18.474570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 93/192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:18 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:18.479969 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:18.480720 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:18.486648 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:18.487236 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:18.487772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:18.488552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:18.489158 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:18.490252 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:18.518014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-04b663c5-7269-4864-928c-d7bcdac0637f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675815 Sep 22 22:11:18.518653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 100/193] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:11:18.524298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:18.525274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:18.532312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:18.533035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:18.533670 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:18.534526 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:18.535142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:18.535770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:18.689425 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:18.698381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9b9ab2b4-8e75-428f-94a6-21e27654e2d5 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.222531 Sep 22 22:11:18.699431 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 94/194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:18 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:18.704768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0f733c2-8b89-46c2-9129-8c4302ae3d57 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:18.705497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0f733c2-8b89-46c2-9129-8c4302ae3d57 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:18.721706 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:18.733709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1c013252-4e54-4036-98d7-0082f3d6bab7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.213579 Sep 22 22:11:18.734542 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 101/195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:18 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:18.766787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0f733c2-8b89-46c2-9129-8c4302ae3d57 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:18.774276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0f733c2-8b89-46c2-9129-8c4302ae3d57 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1218 microversion: 2.1 time: 0.073149 Sep 22 22:11:18.785284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 95/196] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:18 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:19.498927 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:19.499582 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:19.505696 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:19.506181 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:19.506615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:19.507305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:19.508517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:19.508945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:19.639809 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:19.647865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-05851360-94be-45bb-ae0d-1bc1671cf4c5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.152634 Sep 22 22:11:19.648586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 102/197] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:19 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:19.723349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:19.723954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:19.732173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:19.732840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:19.733444 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:19.734299 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:19.734907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:19.735468 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:19.757352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:19.757974 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:19.764655 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:19.765373 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:19.765968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:19.766667 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:19.767121 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:19.767732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:19.957493 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:19.962989 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:19.966660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2e72ef77-41b4-40cd-819e-c48617f1ae6d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.247252 Sep 22 22:11:19.967455 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 96/198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:19 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:19.971676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-16932efd-f1a7-4c7a-bd6a-b13a5a0c96d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.218719 Sep 22 22:11:19.972224 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:19.972340 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 103/199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:19 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:19.973345 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:19.979967 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:19.984532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:19.984532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:19.984532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:19.984532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:19.985006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:20.049205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:20.057320 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1dd70f6e-0e49-4423-bd39-d46623fa93d7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1222 microversion: 2.1 time: 0.088538 Sep 22 22:11:20.058071 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 97/200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:19 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:20.671861 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:20.672463 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:20.678231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:20.678708 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:20.679208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:20.680853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:20.681404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:20.681830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:20.815607 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:20.824151 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d5198771-2c05-4e6e-89d0-3a026b90e27b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.156050 Sep 22 22:11:20.824810 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 104/201] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:20 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:20.989848 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:20.990578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:20.993262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=78 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:20.998037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:20.999201 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:20.999441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:20.999686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:21.000137 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:21.000811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:21.001400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:21.001835 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:21.008500 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:21.009335 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:21.010131 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:21.010980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:21.011637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:21.012210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:21.022636 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:21.375096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:21.379400 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:21.383696 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2399c554-f217-4402-8543-3b0318953ed6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.397548 Sep 22 22:11:21.384370 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 98/202] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:20 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:21.387193 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4c96ece5-0d10-496b-a26b-bb0c348633e4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.395684 Sep 22 22:11:21.387753 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 105/203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:20 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:21.393806 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:21.394520 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:21.400929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:21.401542 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:21.402068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:21.402860 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:21.403408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:21.403890 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:21.466750 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:21.474361 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b0011ecd-de9e-4633-8332-63894f596131 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1222 microversion: 2.1 time: 0.084146 Sep 22 22:11:21.475025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 99/204] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:21 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:21.850183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:21.850826 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:21.857134 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:21.857618 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:21.858049 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:21.858729 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:21.859176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:21.859594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:21.984627 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:21.992188 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-da9eebe8-f368-4cb8-b973-15b0825273a1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.145809 Sep 22 22:11:21.992841 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 106/205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:21 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:22.410912 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:22.411511 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:22.411638 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:22.412135 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:22.417680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:22.418161 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:22.418403 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:22.418587 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:22.418888 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:22.419391 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:22.419521 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:22.419711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:22.419987 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:22.420121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:22.420435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:22.420852 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:22.615955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:22.620843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:22.624599 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9a3bb079-cd64-46f7-a49f-73f9d270ef79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.217342 Sep 22 22:11:22.625205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 100/206] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:22 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:22.628882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-406473c5-2461-4af5-9fd0-f3a46653f1ab tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.221131 Sep 22 22:11:22.629664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 107/207] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:22 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:22.629832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:22.630432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:22.636272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:22.636759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:22.637225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:22.637922 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:22.638376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:22.638797 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:22.698728 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:22.706301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c460ab88-7a4e-45cd-89d4-45fb46578e20 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1222 microversion: 2.1 time: 0.080164 Sep 22 22:11:22.706876 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 101/208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:22 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:23.014902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:23.015509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:23.021526 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:23.022005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:23.022435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:23.023709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:23.024256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:23.024679 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:23.157889 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:23.166322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-441350ed-36cf-4699-859f-b666cb8d2819 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.155220 Sep 22 22:11:23.166875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 108/209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:23 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:23.652251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:23.652933 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:23.653658 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:23.653788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:23.660033 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:23.660185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:23.660637 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:23.660736 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:23.661213 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:23.661437 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:23.665574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:23.665676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:23.665765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:23.665849 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:23.665963 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:23.666057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:23.860930 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:23.864096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:23.869391 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ae129110-6a60-4bde-9f23-de354c9c8682 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.221485 Sep 22 22:11:23.869968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 109/210] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:23 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:23.874516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6d99a232-235d-41e0-83d4-689fc5fe024a tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.224810 Sep 22 22:11:23.874516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 102/211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:23 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:23.874722 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:23.874965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:23.880626 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:23.881126 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:23.881559 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:23.882310 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:23.883285 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:23.883709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:23.943766 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:23.951944 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a8743dcf-dfe1-49cc-a23a-588f1314406d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.081042 Sep 22 22:11:23.952510 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 110/212] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:23 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:24.189930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:24.190596 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:24.196593 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:24.197004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:24.197459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:24.198135 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:24.198578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:24.198993 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:24.338984 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:24.346506 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d43e27f4-50f7-4e2d-8e33-fae4d39b9835 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.160423 Sep 22 22:11:24.347151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 103/213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:24 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:24.892706 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:24.893348 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:24.896058 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:24.896783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:24.899994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:24.900326 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:24.900748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:24.901485 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:24.901935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:24.902349 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:24.905061 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:24.905578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:24.907552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:24.907675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:24.907776 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:24.907776 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:24.907946 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:25.110226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:25.119431 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:25.120119 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d040f9d2-8f57-49a2-9dd8-2c568a83ef10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.231079 Sep 22 22:11:25.120978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 111/214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:24 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:25.125576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:25.126671 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:25.129443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-73822ec8-2c40-4412-9fcf-a39efa858115 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.237252 Sep 22 22:11:25.136559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 104/215] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:24 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:25.140857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:25.141440 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:25.141937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:25.142734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:25.143185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:25.143599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:25.208603 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:25.216319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4e9c2db0-231b-47da-b076-3e867b99c4f4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.094427 Sep 22 22:11:25.216948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 112/216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:25 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:25.370809 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:25.371448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:25.377355 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:25.377840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:25.378274 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:25.378960 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:25.379412 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:25.380033 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:25.562236 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:25.573386 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4bb82e15-2c0e-49c4-bffa-bc2cb6a32f81 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.207087 Sep 22 22:11:25.585449 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 105/217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:25 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:25.634363 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-349314ca-3b49-4946-b139-9fce8ce9d04c req-3bce2706-240d-4701-b143-921e8d164234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765e0b40-b687-4b25-b264-0b84e9d0a8a3", "name": "network-vif-plugged", "status": "completed", "tag": "1f73d7aa-997f-4856-81f0-98fb975bdbf8"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:11:25.649229 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-349314ca-3b49-4946-b139-9fce8ce9d04c req-3bce2706-240d-4701-b143-921e8d164234 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:25.650695 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-349314ca-3b49-4946-b139-9fce8ce9d04c req-3bce2706-240d-4701-b143-921e8d164234 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:25.651460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-349314ca-3b49-4946-b139-9fce8ce9d04c req-3bce2706-240d-4701-b143-921e8d164234 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:25.670110 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-349314ca-3b49-4946-b139-9fce8ce9d04c req-3bce2706-240d-4701-b143-921e8d164234 service nova] Creating event network-vif-plugged:1f73d7aa-997f-4856-81f0-98fb975bdbf8 for instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 on hv-cinder-84914 Sep 22 22:11:25.678474 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-349314ca-3b49-4946-b139-9fce8ce9d04c req-3bce2706-240d-4701-b143-921e8d164234 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050839 Sep 22 22:11:25.679191 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 113/218] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:11:26.142654 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:26.143372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:26.150034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:26.150588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:26.151128 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:26.151886 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:26.152426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:26.152910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:26.169205 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:26.171293 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:26.179310 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:26.180069 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:26.180684 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:26.181569 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:26.182095 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:26.182682 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:26.438617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:26.449429 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-392e6820-1d92-4a8e-be9d-05f09e889973 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.307346 Sep 22 22:11:26.449429 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 106/219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:26 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:26.456852 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:26.466265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:26.466867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:26.475539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-280d635c-1199-4dfd-a9a8-618e8bb2be7c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.311440 Sep 22 22:11:26.476096 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 114/220] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:26 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:26.487128 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:26.487614 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:26.488040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:26.488724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:26.489192 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:26.489608 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:26.556472 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:26.563939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e74c37b1-d39f-44b8-b849-57cbdc0278ad tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.115778 Sep 22 22:11:26.564677 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 107/221] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:26 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:26.597290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:26.597902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:26.603874 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:26.604536 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:26.604973 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:26.605709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:26.606221 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:26.606651 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:26.741707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:26.750145 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-869bfe65-90a9-45b8-91ea-be4214d9656b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.156801 Sep 22 22:11:26.750710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 115/222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:26 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:27.470402 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:27.471094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:27.477087 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:27.477949 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:27.478499 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:27.479263 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:27.479810 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:27.480309 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:27.499183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:27.499793 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:27.505820 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:27.506305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:27.506740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:27.507429 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:27.507881 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:27.508299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:27.690344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:27.702884 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b5cadda9-3cff-40f9-bcce-e69fbb23415f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.236291 Sep 22 22:11:27.703534 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:27.703685 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 108/223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:27 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:27.709413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:27.710107 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:27.712247 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8afee8bd-0c3f-409a-b80e-e650ee7f6404 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.216587 Sep 22 22:11:27.713399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 116/224] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:27 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:27.725711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:27.726273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:27.726772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:27.728120 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:27.728662 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:27.729005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:27.777690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:27.778537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:27.786280 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:27.786836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:27.787335 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:27.788095 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:27.788689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:27.789308 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:27.793241 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:27.802133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c819ec18-6b2c-4803-b870-177abe5e449b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.097390 Sep 22 22:11:27.803434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 109/225] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:27 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:27.924758 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:27.933857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2f9392dd-1c17-4f5a-8aba-5f7d984af986 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.163409 Sep 22 22:11:27.934445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 117/226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:27 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:28.726168 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:28.726772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:28.733194 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:28.733674 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:28.734109 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:28.734792 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:28.735240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:28.735615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:28.736005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:28.736213 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:28.738245 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:28.739098 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:28.745545 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:28.746028 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:28.746482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:28.747166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:28.747635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:28.748051 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:28.770532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:28.930578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:28.938735 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6afb2122-981d-45cf-954e-826d4a5923d8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.216408 Sep 22 22:11:28.939485 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 110/227] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:28 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:28.941857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:28.944080 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:28.944769 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:28.952084 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:28.952625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7d64b3ba-f791-488a-841a-3f3213108de1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.219104 Sep 22 22:11:28.953171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:28.953460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 118/228] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:28 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:28.955352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:28.955352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:28.955352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:28.955642 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:28.958887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:28.959592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:28.966287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:28.966991 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:28.967649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:28.968416 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:28.968932 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:28.969611 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:29.027668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:29.035111 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-278e6c86-3d75-4e17-8566-08946df5af74 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.094628 Sep 22 22:11:29.035678 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 111/229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:28 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:29.113444 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:29.121198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6ade4975-e75c-4f13-af9a-0db413dd5268 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.166801 Sep 22 22:11:29.121790 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 119/230] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:28 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:29.962703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:29.963303 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:29.969293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:29.969777 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:29.970218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:29.970902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:29.971357 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:29.971780 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:29.979584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:29.980195 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:29.986073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:29.986549 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:29.986983 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:29.987698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:29.988147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:29.988563 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:30.156051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:30.164056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-373202ee-6d41-426c-9860-c620e4b89fb0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.205220 Sep 22 22:11:30.176297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 112/231] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:29 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:30.178602 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:30.181129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:30.182068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:30.187981 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8edc2a18-4bc6-4aca-9bc2-348183fcdbb4 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.212626 Sep 22 22:11:30.188436 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:30.188960 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:30.189443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:30.190193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:30.190673 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:30.191097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:30.201459 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 120/232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:29 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:30.208510 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:30.209172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:30.215646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:30.216132 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:30.216594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:30.217393 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:30.217840 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:30.218250 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:30.259593 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:30.267329 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8f2d573e-77e4-4920-b377-d73e7b2be7b3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.101081 Sep 22 22:11:30.268114 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 113/233] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:30 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:30.356301 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:30.364421 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a76da3ca-c7e0-4ad6-8c60-2b883b25b2ed tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.162017 Sep 22 22:11:30.364985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 121/234] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:30 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:31.187934 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:31.188552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:31.194535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:31.194954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:31.195388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:31.196328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:31.196857 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:31.197323 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:31.215836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:31.216571 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:31.223026 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:31.223590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:31.224092 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:31.224853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:31.225409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:31.225902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:31.407940 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:31.420604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3b2f2925-1f66-480f-a96b-38db183a3f1e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.236501 Sep 22 22:11:31.421243 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 114/235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:31 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:31.422494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:31.425854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:31.426974 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:31.432223 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e7e1a3fc-eb79-4b18-b6a9-a107669beadc tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.220547 Sep 22 22:11:31.432800 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 122/236] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:31 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:31.433961 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:31.434717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:31.435274 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:31.436079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:31.436635 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:31.437184 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:31.439058 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:31.439659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:31.441545 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:31.447203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:31.447879 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:31.448313 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:31.449002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:31.449480 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:31.449901 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:31.511813 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:31.519930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4eb00454-4791-4d38-a82d-656811b5d89b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.097635 Sep 22 22:11:31.520511 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 115/237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:31 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:31.765205 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:31.776186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b7cca871-6015-4f46-804e-48837be5c097 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.342152 Sep 22 22:11:31.776776 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 123/238] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:31 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:32.444685 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:32.445297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:32.452319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:32.452906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:32.453499 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:32.454173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:32.454761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:32.455262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:32.456561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:32.457347 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:32.463238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:32.463716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:32.464144 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:32.464827 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:32.465306 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:32.465722 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:32.653933 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:32.660330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:32.661730 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dd89dddc-2180-4b4b-bf09-d91917fae68d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.220972 Sep 22 22:11:32.662601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 116/239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:32 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:32.667416 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:32.668165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:32.668715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8fc5fb53-6e77-4762-99f2-0e32092bd3c2 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.216903 Sep 22 22:11:32.677157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 124/240] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:32 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:32.677319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:32.677319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:32.677319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:32.677319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:32.677604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:32.677604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:32.737812 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:32.746337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1d033503-210f-4773-b597-5c9595755014 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.082787 Sep 22 22:11:32.746911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 117/241] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:32 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:32.801904 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:32.802505 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:32.808611 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:32.809082 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:32.809540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:32.810207 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:32.810649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:32.811058 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:32.937663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:32.945992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e0d2ef97-af1e-4c9b-a701-b9ebc531c585 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.147294 Sep 22 22:11:32.946644 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 125/242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:32 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:33.686676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:33.687412 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:33.692552 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:33.693195 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:33.693589 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:33.694077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:33.694511 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:33.695207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:33.696284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:33.697022 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:33.699948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:33.700461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:33.700902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:33.701620 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:33.702156 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:33.702582 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:33.895261 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:33.900314 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:33.903836 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-166830ed-efe8-4d13-bf2a-e03426acd210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.221360 Sep 22 22:11:33.904495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 118/243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:33 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:33.908907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:33.909560 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:33.910979 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8cfe2447-1c2f-4e4f-898b-66840c528176 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.222251 Sep 22 22:11:33.911651 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 126/244] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:33 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:33.915423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:33.915906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:33.916336 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:33.917017 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:33.917492 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:33.917910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:33.969913 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:33.970659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:33.976711 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:33.977314 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:33.978520 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:33.979278 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:33.979759 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:33.980143 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:33.982218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:33.989706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ecb06f8f-9900-4301-b0d8-7cf27c4b93f5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.084263 Sep 22 22:11:33.990266 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 119/245] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:33 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:34.107042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:34.114620 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-10d1ad44-98d0-453b-9eaf-5f4393b69468 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.148566 Sep 22 22:11:34.115180 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 127/246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:33 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:34.927596 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:34.928209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:34.934368 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:34.934813 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:34.935006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:34.935100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:34.935432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:34.936127 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:34.936575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:34.936997 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:34.941493 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:34.942042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:34.942572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:34.943580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:34.944105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:34.944590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:34.964704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:35.154234 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:35.162397 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c0e8b461-deb0-4826-99ea-7f4e7474bc3b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.238258 Sep 22 22:11:35.171115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:35.171769 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 120/247] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:34 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:35.177749 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:35.178571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:35.180087 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8144fc2e-5588-47a9-8139-1c7fdc805d18 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1315 microversion: 2.1 time: 0.249346 Sep 22 22:11:35.183664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 128/248] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:34 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:35.185772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:35.186423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:35.187021 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:35.187886 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:35.188481 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:35.188973 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:35.189234 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:35.189609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:35.199294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:35.200592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:35.201023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:35.201759 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:35.202257 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:35.202680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:35.267535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:35.276269 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ae50c017-af65-496b-8fcf-51aeb423908c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.102909 Sep 22 22:11:35.292087 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 121/249] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:35 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:35.365263 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:35.373263 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-26797e3e-7554-4884-939d-691d8a6dfe4f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.188553 Sep 22 22:11:35.373832 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 129/250] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:35 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:36.188680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:36.194016 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:36.202390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:36.202875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:36.205639 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:36.206578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:36.207212 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:36.207912 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:36.210910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:36.211665 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:36.218332 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:36.218912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:36.219666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:36.220558 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:36.221117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:36.221614 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:36.433898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:36.441576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9913f107-67e3-4e41-9ea6-f2f092760757 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1503 microversion: 2.1 time: 0.235544 Sep 22 22:11:36.445435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:36.448734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 130/251] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:36 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:36.452985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f45a6450-eb8f-4127-924c-1d10413c57ac tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.270433 Sep 22 22:11:36.457808 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:36.458583 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 122/252] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:36 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:36.463905 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:36.464495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:36.466824 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:36.474529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:36.475014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:36.475864 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:36.476131 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:36.477376 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:36.477631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:36.486512 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:36.487133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:36.487652 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:36.488365 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:36.488824 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:36.489337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:36.571817 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:36.580136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd35696f-01d8-42b6-9410-ded1f4413aa5 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.125952 Sep 22 22:11:36.581035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 131/253] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:36 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:36.647950 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:36.656532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5ca42c43-a72a-4d6d-8e04-e124014142bc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1322 microversion: 2.1 time: 0.196775 Sep 22 22:11:36.657179 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 123/254] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:36 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:37.482431 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:37.483330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:37.495421 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.496585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.497430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.498350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.498882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.499380 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.605067 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:37.605753 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:37.615516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.615924 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.618959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.619833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.620465 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.621049 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.680386 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:37.696185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ea79e1cf-f609-400b-a4f1-b81dc88f7457 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.218414 Sep 22 22:11:37.696968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 132/255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:37 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:37.710720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:37.712059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:37.719272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.720147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.720822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.721635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.722313 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.723103 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.727811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:37.736438 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-74e4a153-e65e-4c52-a14f-930f3b8bf95e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.136501 Sep 22 22:11:37.737038 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 124/256] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:37 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:37.748741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-8bb7f504-9c48-4fc6-a964-b37666f05a90 req-cdf24ac2-2e02-4662-8d00-f81d17014c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b462de-3ef3-4c76-bf6c-f1ce9edcda5b", "name": "network-vif-plugged", "status": "completed", "tag": "8663b072-db48-4fbd-b30f-98d4794fd966"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:11:37.760193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8bb7f504-9c48-4fc6-a964-b37666f05a90 req-cdf24ac2-2e02-4662-8d00-f81d17014c8b service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.761502 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8bb7f504-9c48-4fc6-a964-b37666f05a90 req-cdf24ac2-2e02-4662-8d00-f81d17014c8b service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.762591 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8bb7f504-9c48-4fc6-a964-b37666f05a90 req-cdf24ac2-2e02-4662-8d00-f81d17014c8b service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.777832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-8bb7f504-9c48-4fc6-a964-b37666f05a90 req-cdf24ac2-2e02-4662-8d00-f81d17014c8b service nova] Creating event network-vif-plugged:8663b072-db48-4fbd-b30f-98d4794fd966 for instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b on hv-cinder-84914 Sep 22 22:11:37.785322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-8bb7f504-9c48-4fc6-a964-b37666f05a90 req-cdf24ac2-2e02-4662-8d00-f81d17014c8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040543 Sep 22 22:11:37.786087 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 125/257] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:11:37.879065 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cbfb9207-94c5-4ebd-970c-4779916b258b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc19daa9-7a23-4c62-bd7b-7bbc00953a08"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:11:37.881708 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cbfb9207-94c5-4ebd-970c-4779916b258b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:37.883372 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:37.890462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbfb9207-94c5-4ebd-970c-4779916b258b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.891050 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbfb9207-94c5-4ebd-970c-4779916b258b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.891534 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbfb9207-94c5-4ebd-970c-4779916b258b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.892422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbfb9207-94c5-4ebd-970c-4779916b258b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.893328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbfb9207-94c5-4ebd-970c-4779916b258b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.893816 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cbfb9207-94c5-4ebd-970c-4779916b258b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.894542 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-66b531b4-d353-4e07-826c-591bd0f5e3e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1515 microversion: 2.1 time: 0.196725 Sep 22 22:11:37.895310 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 133/258] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:37 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:37.919820 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:11:37.922872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:37.931212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.931721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.932162 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:37.932864 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:37.933688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:37.934148 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:38.002851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lazy-loading 'flavor' on Instance uuid e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:11:38.123945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-892cfbd0-3730-4ba9-8544-ab9bc93b4b87 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4/action" status: 200 len: 32 microversion: 2.1 time: 0.209179 Sep 22 22:11:38.124560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 134/259] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:11:37 2022] POST /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 22:11:38.141204 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:38.142993 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:38.153014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:38.153914 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:38.154590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:38.155539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:38.155993 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:38.156423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:38.292652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:38.300311 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-45728514-235f-46dd-8f63-b22debfe63f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.170155 Sep 22 22:11:38.300868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 135/260] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:38 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:38.719871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:38.720504 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:38.727102 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:38.727598 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:38.728042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:38.728745 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:38.729229 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:38.729655 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:38.860966 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:38.869874 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ec481ab6-385f-4e05-b584-ab69bca5c6b0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.153841 Sep 22 22:11:38.870453 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 136/261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:38 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:38.874941 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:38.875531 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:38.881294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:38.881763 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:38.882188 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:38.883452 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:38.883901 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:38.884316 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:38.951495 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:38.959201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f52747f8-e9e5-4ad0-9f3a-424482f022ca tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.087801 Sep 22 22:11:38.959747 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 137/262] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:38 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:39.325172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:39.325704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:39.331640 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:39.332113 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:39.332543 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:39.333260 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:39.333763 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:39.334212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:39.461697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:39.469213 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bc96eaf7-83f9-4733-8e12-5d71849e6e2b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.147924 Sep 22 22:11:39.469776 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 138/263] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:39 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:39.893524 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:39.894159 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:39.900853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:39.901358 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:39.901786 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:39.902458 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:39.902900 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:39.903318 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:40.038915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:40.046808 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-527ee1b0-b753-4e2b-b5cf-cb67f1bd692c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.157083 Sep 22 22:11:40.047370 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 139/264] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:39 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:40.051722 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:40.052328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:40.059008 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:40.059507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:40.059930 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:40.060622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:40.061080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:40.061530 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:40.128681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:40.136955 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e0243a28-635b-435a-a909-562e0414b6ee tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.088620 Sep 22 22:11:40.137550 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 140/265] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:40 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:40.493257 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:40.493870 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:40.499771 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:40.500261 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:40.500697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:40.501412 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:40.501868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:40.502293 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:40.637281 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:40.645050 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7aee6bbc-58f5-448b-958e-0507054ba8f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.156229 Sep 22 22:11:40.645639 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 141/266] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:40 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:41.069296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:41.069906 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:41.071958 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:41.077464 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:41.077954 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:41.078388 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:41.079099 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:41.079557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:41.079979 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:41.216859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:41.224555 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d1c127cf-f19d-4738-b74e-6810090d1fef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.159230 Sep 22 22:11:41.225130 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 142/267] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:41 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:41.229975 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:41.230609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:41.236125 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:41.236604 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:41.237041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:41.237762 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:41.238213 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:41.238632 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:41.243147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:41.307412 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:41.315233 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-690d6677-b186-4a4b-9c6e-edb260e82976 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.089079 Sep 22 22:11:41.315822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 143/268] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:41 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:41.668110 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:41.668625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:41.674639 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:41.675117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:41.675551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:41.676231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:41.676683 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:41.677136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:41.808148 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:41.816308 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e3a20efd-1937-4755-91a6-328bfc2aa593 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.152684 Sep 22 22:11:41.816923 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 144/269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:41 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:42.248395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:42.249002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:42.254979 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:42.255469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:42.255902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:42.256591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:42.257044 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:42.257487 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:42.384763 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:42.392528 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c03fbac1-820e-436b-8208-3388e3fbb5e9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.148144 Sep 22 22:11:42.393088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 145/270] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:42 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:42.397521 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:42.398118 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:42.405145 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:42.405145 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:42.405383 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:42.406736 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:42.407464 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:42.407912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:42.473201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:42.481903 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b3644ebf-1c42-4f22-9bd2-6b5b8a369d8a tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.087702 Sep 22 22:11:42.482480 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 146/271] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:42 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:42.840952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:42.841577 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:42.847513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:42.847992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:42.848428 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:42.849123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:42.849583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:42.850001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:42.979992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:42.987915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-34999fd4-6b23-41fc-aada-1a3072bb814d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.151489 Sep 22 22:11:42.988475 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 147/272] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:42 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:43.415199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:43.415797 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:43.421620 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:43.422105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:43.422540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:43.423228 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:43.423681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:43.424103 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:43.557292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:43.565043 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6e0a97e9-e9d7-486f-8cbf-2231cf8cee0d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.153791 Sep 22 22:11:43.565639 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 148/273] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:43 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:43.570012 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:43.570648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:43.576123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:43.576694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:43.577237 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:43.577993 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:43.578509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:43.579001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:43.642847 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:43.651208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ae588811-319a-4563-90a3-4f0ace869da6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.084597 Sep 22 22:11:43.651786 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 149/274] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:43 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:44.010952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:44.011696 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:44.017566 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:44.018047 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:44.018475 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:44.019153 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:44.019602 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:44.020023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:44.146658 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:44.155022 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0e8f001c-4fb1-4c3d-b607-8fc8df80ded4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.147968 Sep 22 22:11:44.155590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 150/275] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:44 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:44.588391 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:44.589005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:44.594944 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:44.595428 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:44.595862 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:44.596556 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:44.597010 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:44.597464 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:44.728028 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:44.735740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-74fadb44-b154-47dc-9557-71fd89b77737 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.151694 Sep 22 22:11:44.736305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 151/276] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:44 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:44.740586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:44.741206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:44.747570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:44.748030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:44.748461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:44.749179 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:44.749637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:44.750061 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:44.814935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:44.823515 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c94abd34-2735-43e7-8528-abde52a56abe tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.086264 Sep 22 22:11:44.824078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 152/277] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:44 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:45.179341 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:45.180761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:45.186709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:45.187189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:45.187618 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:45.188299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:45.188750 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:45.189209 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:45.322769 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:45.330723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-81499fc9-ce35-4cfd-b05d-5bcf5d866f1e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.155505 Sep 22 22:11:45.331287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 153/278] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:45 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:45.759960 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:45.760571 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:45.766585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:45.767074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:45.767518 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:45.768208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:45.768666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:45.769090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:45.907850 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:45.915649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-00ee6a68-616c-47db-838c-986b1979ef67 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1368 microversion: 2.1 time: 0.160045 Sep 22 22:11:45.916218 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 154/279] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:45 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:45.920690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:45.921328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:45.926881 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:45.927462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:45.927883 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:45.928878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:45.929454 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:45.930053 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:45.990962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:45.998915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5d9b3e76-3fab-40d2-ae07-c4940cd9d753 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1214 microversion: 2.1 time: 0.081673 Sep 22 22:11:45.999507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 155/280] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:45 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:46.354232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:46.354855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:46.370996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:46.371840 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:46.372669 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:46.373531 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:46.374000 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:46.375000 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:46.566467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cbfb9207-94c5-4ebd-970c-4779916b258b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "POST /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.692531 Sep 22 22:11:46.567374 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 126/281] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:11:37 2022] POST /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1/os-volume_attachments => generated 194 bytes in 8695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:11:46.598712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:46.608830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fae59374-1f99-49c0-bd08-ebd387fb38a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.258766 Sep 22 22:11:46.609469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 156/282] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:46 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:46.939706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:46.940486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:46.951940 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:46.952435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:46.952872 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:46.953652 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:46.954107 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:46.954526 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:47.023071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:47.026399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:47.042131 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:47.042630 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:47.044794 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:47.046603 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:47.047076 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:47.047513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:47.146642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:47.158522 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-42acaade-9e32-49ca-895c-a96439dd31f7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1270 microversion: 2.1 time: 0.139468 Sep 22 22:11:47.159486 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 157/283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:47 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:47.185904 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:47.194328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-961a3c6c-5c4e-4fba-a9c1-bc94c91440a9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1559 microversion: 2.1 time: 0.258817 Sep 22 22:11:47.205360 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 127/284] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:46 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1559 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:47.219128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-478dd8d0-fbb0-48b2-8874-5bd9a699dc82 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:47.219861 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-478dd8d0-fbb0-48b2-8874-5bd9a699dc82 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:47.226846 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478dd8d0-fbb0-48b2-8874-5bd9a699dc82 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:47.227434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478dd8d0-fbb0-48b2-8874-5bd9a699dc82 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:47.228062 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478dd8d0-fbb0-48b2-8874-5bd9a699dc82 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:47.229029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478dd8d0-fbb0-48b2-8874-5bd9a699dc82 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:47.229520 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478dd8d0-fbb0-48b2-8874-5bd9a699dc82 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:47.229941 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478dd8d0-fbb0-48b2-8874-5bd9a699dc82 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:47.359129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-478dd8d0-fbb0-48b2-8874-5bd9a699dc82 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143912 Sep 22 22:11:47.361815 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 158/285] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 22 22:11:47 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:11:47.633650 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:47.634317 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:47.640689 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:47.641419 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:47.645645 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:47.646455 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:47.647515 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:47.648105 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:48.183931 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:48.185491 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:48.192111 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:48.192982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:48.193664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:48.194969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:48.196257 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:48.197287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:48.325187 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:48.335288 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bc2a1c69-a296-45af-82fe-d00242de53b9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.706043 Sep 22 22:11:48.336571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 128/286] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:47 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:48.362507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:48.371876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cd11f5c1-b869-487d-9b73-37f39da101ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1270 microversion: 2.1 time: 0.193705 Sep 22 22:11:48.372451 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 159/287] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:48 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:49.317426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-c6a744cc-236a-4d71-b6b1-5c4ce9511cae req-675fc226-3b32-4ecc-adac-997dcaeccd3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "765e0b40-b687-4b25-b264-0b84e9d0a8a3", "tag": "1f73d7aa-997f-4856-81f0-98fb975bdbf8"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:11:49.335360 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c6a744cc-236a-4d71-b6b1-5c4ce9511cae req-675fc226-3b32-4ecc-adac-997dcaeccd3f service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:49.336389 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c6a744cc-236a-4d71-b6b1-5c4ce9511cae req-675fc226-3b32-4ecc-adac-997dcaeccd3f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:49.337013 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-c6a744cc-236a-4d71-b6b1-5c4ce9511cae req-675fc226-3b32-4ecc-adac-997dcaeccd3f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:49.351462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-c6a744cc-236a-4d71-b6b1-5c4ce9511cae req-675fc226-3b32-4ecc-adac-997dcaeccd3f service nova] Creating event network-changed:1f73d7aa-997f-4856-81f0-98fb975bdbf8 for instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 on hv-cinder-84914 Sep 22 22:11:49.359034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-c6a744cc-236a-4d71-b6b1-5c4ce9511cae req-675fc226-3b32-4ecc-adac-997dcaeccd3f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045931 Sep 22 22:11:49.360083 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 129/288] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:11:49.360222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:49.360889 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:49.372405 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:49.373402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:49.374580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:49.376246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:49.377540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:49.378462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:49.385920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:49.398559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:49.399562 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:49.412492 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:49.413418 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:49.414211 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:49.415915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:49.417682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:49.419050 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:49.545311 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:49.557337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-681869e6-885c-4de8-80b4-3cb8c92a6b1e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1278 microversion: 2.1 time: 0.163913 Sep 22 22:11:49.558207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 130/289] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:49 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:49.699165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:49.712193 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f4023386-4bad-4143-85fb-0d03dfe4cc15 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.356062 Sep 22 22:11:49.725702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 160/290] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:49 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:50.586363 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:50.587655 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:50.597709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:50.602019 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:50.602789 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:50.603961 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:50.604586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:50.605308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:50.740223 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:50.740832 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:50.744439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:50.748403 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:50.749157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:50.749743 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:50.750592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:50.751208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:50.751773 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:50.752055 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:50.755700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6b5486a4-e95d-4945-b755-d3f20751e415 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1276 microversion: 2.1 time: 0.174433 Sep 22 22:11:50.769904 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 131/291] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:50 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:51.157189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:51.169824 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-25eb57ac-78da-47a8-85f9-f50565dce096 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.433205 Sep 22 22:11:51.178895 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 161/292] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:50 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:51.782915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:51.784103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:51.798009 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=68 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:11:51.799979 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:51.800982 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:51.801536 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:51.802567 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:51.803092 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:51.803843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:52.042125 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:52.063276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4e696395-174f-4116-ba26-f2a7cd8479ec tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.286553 Sep 22 22:11:52.076718 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 132/293] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:51 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:52.196636 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:52.197841 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:52.204693 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:52.205440 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:52.206037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:52.206894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:52.207499 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:52.208088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:52.427782 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:52.436236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-66259e6e-7f4e-4bf6-846a-c214cb1f1d94 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.244269 Sep 22 22:11:52.459448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 162/294] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:52 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:52.700801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-ab447ffc-3102-438a-a429-41090daba75d req-c8c96cd8-5efd-4733-aae0-1ed5f082e785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db03f26-beec-4475-8f6d-395416d4a030", "tag": "f669f0bc-c901-4213-87e9-b6ba474f53a7"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:11:52.712956 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ab447ffc-3102-438a-a429-41090daba75d req-c8c96cd8-5efd-4733-aae0-1ed5f082e785 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:52.713923 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ab447ffc-3102-438a-a429-41090daba75d req-c8c96cd8-5efd-4733-aae0-1ed5f082e785 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:52.714523 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ab447ffc-3102-438a-a429-41090daba75d req-c8c96cd8-5efd-4733-aae0-1ed5f082e785 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:52.727766 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-ab447ffc-3102-438a-a429-41090daba75d req-c8c96cd8-5efd-4733-aae0-1ed5f082e785 service nova] Creating event network-changed:f669f0bc-c901-4213-87e9-b6ba474f53a7 for instance 2db03f26-beec-4475-8f6d-395416d4a030 on hv-cinder-84914 Sep 22 22:11:52.734502 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-ab447ffc-3102-438a-a429-41090daba75d req-c8c96cd8-5efd-4733-aae0-1ed5f082e785 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037494 Sep 22 22:11:52.735103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 133/295] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:11:53.100668 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:53.100951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:53.108401 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:53.108947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:53.109489 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:53.110315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:53.110893 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:53.111372 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:53.306970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:53.315455 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d5608614-3c7d-4ef9-af78-62e0488e7091 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.219388 Sep 22 22:11:53.316479 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 163/296] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:53 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:53.466310 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:53.466924 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:53.473610 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:53.474100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:53.474532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:53.475227 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:53.475833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:53.476549 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:53.643032 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:53.653908 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9dec459e-5b07-44ae-b6d2-242ee12c15e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.193698 Sep 22 22:11:53.657172 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 134/297] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:53 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:54.340435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:54.341029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:54.347369 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:54.347890 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:54.348323 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:54.349014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:54.349493 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:54.349912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:54.483147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:54.490756 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5dc494b6-9705-4407-99e8-ee5ed9b2357c tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.154277 Sep 22 22:11:54.491321 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 164/298] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:54 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:54.680703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:54.681366 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:54.687788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:54.688214 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:54.688650 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:54.689364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:54.689820 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:54.690243 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:54.824893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:54.833355 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-87d52ee8-225a-475b-bec6-88df96542962 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.156693 Sep 22 22:11:54.833920 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 135/299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:54 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:55.513943 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:55.514589 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:55.520851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:55.521360 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:55.522224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:55.523675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:55.524246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:55.524675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:55.857881 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:55.859654 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:55.865130 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:55.867581 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:55.868091 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:55.868549 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:55.869316 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:55.869921 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:55.870338 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:55.874692 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2b2aa3da-0534-4fbd-a841-557371ef8435 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.364866 Sep 22 22:11:55.875459 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 165/300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:55 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:56.052618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:56.060863 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1f6e4aa3-3dc3-4150-91d8-9ef6619783a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.206891 Sep 22 22:11:56.067043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 136/301] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:55 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:56.899512 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:56.900106 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:56.906015 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:56.906494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:56.906923 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:56.907609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:56.908052 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:56.908633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:57.083817 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:57.084462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:57.084852 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:57.091115 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:57.091601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:57.092260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:57.093025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:57.093160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-069803e1-ab70-4377-839d-1398cfcd954e tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.198020 Sep 22 22:11:57.093805 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 166/302] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:56 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:57.093955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:57.094564 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:57.232121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:57.240851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f8929f18-c217-49be-945e-03969b42d5be tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.160866 Sep 22 22:11:57.241480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 137/303] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:57 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:11:58.115443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:58.116053 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:58.123155 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:58.123710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:58.127560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:58.127560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:58.127560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:58.127560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:58.258224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:58.265123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:58.266046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:58.266590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6be9aa37-ae9d-4b4e-a375-8d507caa5f30 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.154751 Sep 22 22:11:58.267497 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 167/304] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:58 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:58.274569 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:58.276326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:58.277470 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:58.278376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:58.279015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:58.279763 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:58.438022 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:58.446935 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5ad002c2-bdad-4e52-8a3f-2c01e5b97914 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.186063 Sep 22 22:11:58.453279 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 138/305] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:58 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:59.290799 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:59.291413 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:59.297340 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:59.297812 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:59.298234 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:59.298908 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:59.299351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:59.299760 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:59.427946 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:59.435811 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5c777e34-bb22-429e-a27b-1d25676a8ab4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.149144 Sep 22 22:11:59.436374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 168/306] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:59 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:11:59.469755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:11:59.470393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:11:59.476761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:59.477278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:59.477710 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:59.478393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:11:59.478840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:11:59.479265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:11:59.606457 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:11:59.614014 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f2107086-97f0-4f91-ad21-117e83f3bb1f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.148020 Sep 22 22:11:59.614586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 139/307] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:11:59 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:00.458713 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:00.459327 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:00.465686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:00.466164 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:00.466878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:00.467251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:00.467714 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:00.468178 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:00.597628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:00.606041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8cfe12f1-55ba-45c4-9a8f-7c46ab6b4dcf tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.151042 Sep 22 22:12:00.606611 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 169/308] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:00 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:00.637046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:00.637679 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:00.643987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:00.644466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:00.644897 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:00.645604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:00.646063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:00.646485 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:00.777194 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:00.784850 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8c072f40-f131-4dbc-b071-cd29c3d2a67f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.151527 Sep 22 22:12:00.785495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 140/309] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:00 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:01.628237 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:01.628843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:01.634821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:01.635303 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:01.635737 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:01.636420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:01.636876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:01.637333 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:01.768546 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:01.776439 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8bc72d1f-b93a-4b4e-b98a-68c85724e2d3 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.151958 Sep 22 22:12:01.777075 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 170/310] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:01 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:01.809827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:01.810437 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:01.816911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:01.817328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:01.817764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:01.818525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:01.818987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:01.819439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:01.947218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:01.955030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5fb8713c-5863-4632-a989-5917cb6bfbc8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.149869 Sep 22 22:12:01.955598 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 141/311] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:01 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:02.799627 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:02.800237 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:02.807289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:02.807771 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:02.808205 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:02.808893 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:02.809380 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:02.809804 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:02.978822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:02.979431 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:02.986834 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:02.987738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:02.988160 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:02.989033 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:02.989650 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:02.990218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:03.047137 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:03.057873 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f4e7a469-547e-4304-b895-dd895f51a884 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.261800 Sep 22 22:12:03.072392 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 171/312] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:02 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:03.169057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:03.176838 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-47edb82a-d9f8-45dd-b4ea-137596e8fd19 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.202477 Sep 22 22:12:03.177747 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 142/313] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:02 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:04.067222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:04.067888 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:04.075495 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:04.076000 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:04.076441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:04.077269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:04.077728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:04.078426 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:04.088294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:04.089752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:04.097918 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:04.098895 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:04.099955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:04.101921 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:04.102636 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:04.103294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:04.112186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:12:04.229422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eb13da50-5964-4f2b-8350-39508293bdb1 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 204 len: 0 microversion: 2.1 time: 0.165613 Sep 22 22:12:04.230041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 172/314] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:12:04 2022] DELETE /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:12:04.236217 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-9c3eaf52-3ed6-4601-a64e-97f79b1c0167 req-e2b097e1-0afe-4ea4-853d-d2b03fc219c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db03f26-beec-4475-8f6d-395416d4a030", "name": "network-vif-plugged", "status": "completed", "tag": "f669f0bc-c901-4213-87e9-b6ba474f53a7"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:04.247022 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9c3eaf52-3ed6-4601-a64e-97f79b1c0167 req-e2b097e1-0afe-4ea4-853d-d2b03fc219c4 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:04.247508 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9c3eaf52-3ed6-4601-a64e-97f79b1c0167 req-e2b097e1-0afe-4ea4-853d-d2b03fc219c4 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:04.247938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9c3eaf52-3ed6-4601-a64e-97f79b1c0167 req-e2b097e1-0afe-4ea4-853d-d2b03fc219c4 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:04.259430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-9c3eaf52-3ed6-4601-a64e-97f79b1c0167 req-e2b097e1-0afe-4ea4-853d-d2b03fc219c4 service nova] Creating event network-vif-plugged:f669f0bc-c901-4213-87e9-b6ba474f53a7 for instance 2db03f26-beec-4475-8f6d-395416d4a030 on hv-cinder-84914 Sep 22 22:12:04.264454 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-9c3eaf52-3ed6-4601-a64e-97f79b1c0167 req-e2b097e1-0afe-4ea4-853d-d2b03fc219c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Sep 22 22:12:04.265092 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 173/315] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:12:04.270701 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:04.271396 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:04.278422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:04.278914 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:04.279352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:04.280209 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:04.280634 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:04.281058 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:04.281906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:04.290524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-83b625f1-2299-4d60-b236-ac369a97e320 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.210533 Sep 22 22:12:04.291064 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 143/316] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:04 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:04.295409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:04.296169 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:04.301874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:04.302347 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:04.303024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:04.303737 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:04.304536 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:04.304959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:04.493512 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:04.498724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:04.506402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-67fcda1b-ab11-4c14-9f78-09369ea6583e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.239728 Sep 22 22:12:04.507870 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 174/317] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:04 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:04.508380 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca04dc46-be58-43ed-8bde-3b6cee026ee6 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1555 microversion: 2.1 time: 0.216095 Sep 22 22:12:04.509045 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 144/318] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:04 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:05.313317 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:05.313965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:05.320165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:05.320648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:05.321385 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:05.322168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:05.322619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:05.323037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:05.455487 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:05.459442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:05.464715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cbd2261d-e477-4f59-8b4a-bf5e60de2194 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.155300 Sep 22 22:12:05.465446 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 175/319] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:05 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:05.530725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:05.531325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:05.532248 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:05.532985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:05.538783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:05.539255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:05.539862 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:05.540554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:05.541003 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:05.541442 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:05.541716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:05.542274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:05.542789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:05.543629 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:05.544281 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:05.544776 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:05.810201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:05.816905 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:05.819685 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8799e804-589a-4da7-aede-32b75c75bfef tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1555 microversion: 2.1 time: 0.291471 Sep 22 22:12:05.822307 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 176/320] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:05 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1555 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:05.843822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8236c74e-a788-4a3c-8c64-bd9f6e062460 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.316759 Sep 22 22:12:05.857966 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 145/321] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:05 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:06.487979 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:06.489350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:06.497990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:06.498476 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:06.501591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:06.502315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:06.502773 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:06.503392 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:06.705406 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:06.717357 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ed3a4925-d7d3-442d-b011-d1af6adcbffd tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.232716 Sep 22 22:12:06.718196 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 177/322] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:06 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:06.850348 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:06.852000 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:06.877091 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:06.877774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:06.878237 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:06.879032 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:06.879503 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:06.879964 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:06.883998 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:06.885089 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:06.892508 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:06.892793 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:06.893501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:06.894271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:06.894894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:06.895313 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:07.137004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:07.140236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:07.148175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-53bca95d-8d45-431a-8843-262a5f7f4e9b tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1555 microversion: 2.1 time: 0.301190 Sep 22 22:12:07.149324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b4193f05-ee46-4f64-8dae-529c809ab2eb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.275937 Sep 22 22:12:07.161241 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 178/324] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:06 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:07.162006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 146/324] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:06 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1555 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:07.740437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:07.741328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:07.747836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:07.748402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:07.748971 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:07.749930 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:07.750487 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:07.751113 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:07.901912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:07.911012 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-374c2c66-811e-4af0-b8ad-2c15a57f6d63 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.174062 Sep 22 22:12:07.917527 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 179/325] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:07 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:08.176069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:08.176990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:08.179757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:08.181623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:08.184571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:08.185065 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:08.185527 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:08.186230 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:08.186682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:08.187105 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:08.196059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:08.197397 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:08.199370 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:08.200255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:08.200767 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:08.201228 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:08.496308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:08.514026 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7dd2340d-a442-4ec8-9b3f-82c8b0f6348c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.344820 Sep 22 22:12:08.515709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 147/326] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:08 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:08.554206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:08.563023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fba97c67-7fd5-4d4a-9c50-fc54617c3c08 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1555 microversion: 2.1 time: 0.388654 Sep 22 22:12:08.563750 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 180/327] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:08 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1555 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:08.935288 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:08.936074 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:08.942280 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:08.942878 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:08.943417 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:08.944781 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:08.945561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:08.946091 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:09.093757 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:09.102732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b8c43f6e-f3c5-4514-874f-863590e264c8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.171219 Sep 22 22:12:09.103740 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 148/328] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:08 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:09.538861 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:09.540159 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:09.546426 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:09.546909 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:09.547346 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:09.548030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:09.548478 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:09.548898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:09.589464 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:09.590068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:09.604905 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:09.605572 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:09.606624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:09.607429 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:09.608163 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:09.616132 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:09.626828 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:09.755796 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:09.765656 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2c7c5f4d-e9cc-4bf7-9c84-74a5e7714ed6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.230562 Sep 22 22:12:09.766573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 181/329] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:09 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:09.845859 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:09.857313 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5f9ab057-0169-45e8-884e-cbce3ad6648d tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1555 microversion: 2.1 time: 0.271742 Sep 22 22:12:09.858222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 149/330] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:09 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1555 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:10.127508 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:10.128203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:10.134727 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:10.135207 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:10.135637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:10.136334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:10.136772 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:10.137349 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:10.311573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:10.319363 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-307276c0-417c-4445-bc91-9120fabe3915 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.195989 Sep 22 22:12:10.319911 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 182/331] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:10 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:10.602569 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-f58c47c9-1af5-4972-b7b2-212e67429c39 req-48c066bb-e26e-43c2-9905-4fcf34d3ab0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1", "name": "network-vif-unplugged", "status": "completed", "tag": "ff7ff287-6c46-404f-8342-e27e96b08606"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:10.614328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f58c47c9-1af5-4972-b7b2-212e67429c39 req-48c066bb-e26e-43c2-9905-4fcf34d3ab0b service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:10.614815 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f58c47c9-1af5-4972-b7b2-212e67429c39 req-48c066bb-e26e-43c2-9905-4fcf34d3ab0b service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:10.615219 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f58c47c9-1af5-4972-b7b2-212e67429c39 req-48c066bb-e26e-43c2-9905-4fcf34d3ab0b service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:10.630784 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-f58c47c9-1af5-4972-b7b2-212e67429c39 req-48c066bb-e26e-43c2-9905-4fcf34d3ab0b service nova] Creating event network-vif-unplugged:ff7ff287-6c46-404f-8342-e27e96b08606 for instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 on hv-cinder-84914 Sep 22 22:12:10.636510 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-f58c47c9-1af5-4972-b7b2-212e67429c39 req-48c066bb-e26e-43c2-9905-4fcf34d3ab0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038442 Sep 22 22:12:10.637129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 150/332] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:12:10.790694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:10.791302 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:10.797432 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:10.797915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:10.798361 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:10.799054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:10.799518 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:10.799936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:10.884094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:10.885073 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:10.891603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:10.892176 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:10.893179 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:10.894580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:10.895228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:10.895841 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:11.032526 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:11.041928 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-92148ef9-3328-449f-b8ba-88eb9b464e38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.256230 Sep 22 22:12:11.042504 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 183/333] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:10 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:11.098843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:11.107721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-02977e86-af58-477b-b5b4-e17f37e34b91 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1555 microversion: 2.1 time: 0.229167 Sep 22 22:12:11.108282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 151/334] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:10 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:11.343047 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:11.343690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:11.345566 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:11.351006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:11.351485 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:11.351917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:11.352608 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:11.353069 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:11.353516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:11.490406 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:11.498535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-91ee1fa2-d185-47f4-b205-c3383af9a271 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1318 microversion: 2.1 time: 0.159256 Sep 22 22:12:11.499198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 184/335] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:11 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:12.071734 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:12.072425 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:12.078731 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:12.079240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:12.079679 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:12.080480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:12.081271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:12.081537 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:12.131447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:12.133225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:12.142744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:12.143232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:12.143661 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:12.144355 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:12.144800 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:12.145243 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:12.657870 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:12.670396 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-67f21c8f-b962-4c44-81e1-db91022cf464 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.605137 Sep 22 22:12:12.671424 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 152/336] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:12 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:12.676403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:12.677160 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:12.684003 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:12.684552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:12.685218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:12.686565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:12.687127 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:12.687664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:12.725939 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:12.736136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2e3a9012-5896-4243-b5cc-ddc09d891674 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1555 microversion: 2.1 time: 0.608725 Sep 22 22:12:12.736761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 185/337] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:12 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1555 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:12.746996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-0e46ea89-8263-41f6-bb93-9b728c9f4d04 req-6990e001-1e94-4469-9841-d0b947b66099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1", "name": "network-vif-deleted", "tag": "ff7ff287-6c46-404f-8342-e27e96b08606"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:12.762850 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0e46ea89-8263-41f6-bb93-9b728c9f4d04 req-6990e001-1e94-4469-9841-d0b947b66099 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:12.763369 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0e46ea89-8263-41f6-bb93-9b728c9f4d04 req-6990e001-1e94-4469-9841-d0b947b66099 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:12.763858 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0e46ea89-8263-41f6-bb93-9b728c9f4d04 req-6990e001-1e94-4469-9841-d0b947b66099 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:12.781096 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-0e46ea89-8263-41f6-bb93-9b728c9f4d04 req-6990e001-1e94-4469-9841-d0b947b66099 service nova] Creating event network-vif-deleted:ff7ff287-6c46-404f-8342-e27e96b08606 for instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 on hv-cinder-84914 Sep 22 22:12:12.787605 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-0e46ea89-8263-41f6-bb93-9b728c9f4d04 req-6990e001-1e94-4469-9841-d0b947b66099 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046818 Sep 22 22:12:12.788856 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 186/338] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:12:12.867151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:12.875702 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-319ae91e-06eb-48de-a5b4-0ee0e5b90c33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1507 microversion: 2.1 time: 0.203075 Sep 22 22:12:12.876255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 153/339] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:12 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:13.700248 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:13.700964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:13.707097 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:13.707584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:13.708014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:13.708702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:13.709843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:13.709843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:13.762403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:13.764164 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:13.774355 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:13.775140 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:13.775611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:13.776333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:13.776786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:13.777322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:13.870682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:13.879983 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-76b825f1-d528-4baf-bd83-cb6481492710 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1346 microversion: 2.1 time: 0.123189 Sep 22 22:12:13.880944 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 154/340] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:13 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:13.888501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:13.897287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c44c2663-f10c-47da-ba6e-33f3d4d7ef38 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.200920 Sep 22 22:12:13.897855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 187/341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:13 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:14.904248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:14.905027 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:14.911921 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:14.912600 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:14.913048 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:14.913982 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:14.914432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:14.914902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:14.926242 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:14.927060 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:14.934209 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:14.934778 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:14.937683 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:14.938551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:14.939094 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:14.939772 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:14.996268 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:15.007861 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-125f19d7-bd67-45ca-92c4-43324796fdc8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1346 microversion: 2.1 time: 0.107504 Sep 22 22:12:15.008439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 155/342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:14 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:15.098280 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:15.106713 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd0f8a7f-6dbe-4589-a3a3-78c40d688d91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.184400 Sep 22 22:12:15.107290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 188/343] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:14 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:16.035000 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:16.035919 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:16.047218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:16.048245 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:16.048965 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:16.050760 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:16.061542 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:16.069859 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:16.108384 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:16.108943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:16.109656 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:16.110335 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lazy-loading 'fault' on Instance uuid 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:12:16.130738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:16.131986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:16.151293 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:16.151788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:16.152220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:16.152924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:16.153399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:16.153820 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:16.216476 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c9c1aa9349f43e9b56ea4248c3c7f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a52e44d03f74727863b596c606ee35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:16.228381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e2374736-e6b9-4ee4-bef6-d8d3892946f8 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 200 len: 1351 microversion: 2.1 time: 0.200635 Sep 22 22:12:16.229477 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 156/344] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:16 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 1351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:16.329576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:16.341406 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-380a3e9e-2154-4e87-8117-43faf91cf56d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.214164 Sep 22 22:12:16.342344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 189/345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:16 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:17.255132 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:17.256504 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:17.262817 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:17.263376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:17.263817 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:17.264517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:17.264962 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:17.265412 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:17.279538 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] HTTP exception thrown: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Request method failure captured: Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 HTTP/1.1 Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1LLBQBzqyy1dCgsr5DLv5Lax4zjm9vVZ1zf4MJ-h6FA-kW-aJdFbyYqdTknRYRGjYevzUc9k3MZdwkZz4H6lNJJuEcMboj6wtEARJHp7cDZ0Wow7vWkQwB4Hkc80KlnAx1E6NJOaGoR6QmaSBg5C4HZC1UXB_GvU2snJi8lnVPJbA Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 2a52e44d03f74727863b596c606ee35d Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:12:17.284133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2a52e44d03f74727863b596c606ee35d", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 2a52e44d03f74727863b596c606ee35d Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-DeleteServersTestJSON-882644123-project Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 1c9c1aa9349f43e9b56ea4248c3c7f36 Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-DeleteServersTestJSON-882644123-project Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.285426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1'} Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:12:17.286139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.288452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Returning 404 to user: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:12:17.288452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dd473d75-a917-4083-8770-b9dc31e23c9c tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 404 len: 111 microversion: 2.1 time: 0.034340 Sep 22 22:12:17.288452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 157/346] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:17 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:12:17.367867 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:17.368468 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:17.374987 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:17.375499 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:17.375930 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:17.376628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:17.377068 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:17.377515 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:17.414129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:17.416668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:17.422971 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:17.423456 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:17.423884 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:17.424570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:17.425014 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:17.425450 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:17.438969 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] HTTP exception thrown: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Request method failure captured: Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1/os-volume_attachments HTTP/1.1 Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1LLBQBzqyy1dCgsr5DLv5Lax4zjm9vVZ1zf4MJ-h6FA-kW-aJdFbyYqdTknRYRGjYevzUc9k3MZdwkZz4H6lNJJuEcMboj6wtEARJHp7cDZ0Wow7vWkQwB4Hkc80KlnAx1E6NJOaGoR6QmaSBg5C4HZC1UXB_GvU2snJi8lnVPJbA Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 2a52e44d03f74727863b596c606ee35d Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:12:17.440486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2a52e44d03f74727863b596c606ee35d", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 2a52e44d03f74727863b596c606ee35d Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-DeleteServersTestJSON-882644123-project Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 1c9c1aa9349f43e9b56ea4248c3c7f36 Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-DeleteServersTestJSON-882644123-project Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.442079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'server_id': '3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1'} Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:12:17.442900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:17.445459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:12:17.446574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Returning 404 to user: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:12:17.446574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1915a2cb-c7e8-4b53-8b44-86e437a5a892 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032091 Sep 22 22:12:17.446574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 158/347] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:12:17 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 22:12:17.564945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:17.573664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-92342779-65c6-4169-a91b-909609e4ceeb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.209580 Sep 22 22:12:17.585637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 190/348] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:17 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:18.600232 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:18.601326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:18.608008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:18.608488 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:18.608952 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:18.609685 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:18.610165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:18.610608 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:18.775006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:18.775525 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:18.782312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:18.782992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:18.783434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:18.784137 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:18.785394 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:18.785975 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:18.805134 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] HTTP exception thrown: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Request method failure captured: Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 HTTP/1.1 Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1LLBQBzqyy1dCgsr5DLv5Lax4zjm9vVZ1zf4MJ-h6FA-kW-aJdFbyYqdTknRYRGjYevzUc9k3MZdwkZz4H6lNJJuEcMboj6wtEARJHp7cDZ0Wow7vWkQwB4Hkc80KlnAx1E6NJOaGoR6QmaSBg5C4HZC1UXB_GvU2snJi8lnVPJbA Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 2a52e44d03f74727863b596c606ee35d Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:12:18.810222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2a52e44d03f74727863b596c606ee35d", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 2a52e44d03f74727863b596c606ee35d Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-DeleteServersTestJSON-882644123-project Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 1c9c1aa9349f43e9b56ea4248c3c7f36 Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-DeleteServersTestJSON-882644123-project Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.811686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1'} Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:12:18.812461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.813690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.816181 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Returning 404 to user: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:12:18.817246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-240f7f56-c0b6-4cbe-8aef-9fc83da197e7 tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 404 len: 111 microversion: 2.1 time: 0.046731 Sep 22 22:12:18.818765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 191/349] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:12:18 2022] DELETE /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:12:18.826377 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:18.828147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:18.829351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] [instance: 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:18.836501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:18.836879 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:18.837350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:18.838050 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:18.838503 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:18.838926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:18.840053 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2f2a85a4-7f04-4bfc-9f5b-de9028fcec33 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.243912 Sep 22 22:12:18.841225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 159/350] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:18 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:18.877421 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] HTTP exception thrown: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Request method failure captured: Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 HTTP/1.1 Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1LLBQBzqyy1dCgsr5DLv5Lax4zjm9vVZ1zf4MJ-h6FA-kW-aJdFbyYqdTknRYRGjYevzUc9k3MZdwkZz4H6lNJJuEcMboj6wtEARJHp7cDZ0Wow7vWkQwB4Hkc80KlnAx1E6NJOaGoR6QmaSBg5C4HZC1UXB_GvU2snJi8lnVPJbA Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 2a52e44d03f74727863b596c606ee35d Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:12:18.879074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2a52e44d03f74727863b596c606ee35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2a52e44d03f74727863b596c606ee35d", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 2a52e44d03f74727863b596c606ee35d Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-DeleteServersTestJSON-882644123 Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-DeleteServersTestJSON-882644123-project Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 1c9c1aa9349f43e9b56ea4248c3c7f36 Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-DeleteServersTestJSON-882644123-project Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.880258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1'} Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:12:18.881424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. Sep 22 22:12:18.882514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:12:18.883476 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] Returning 404 to user: Instance 3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:12:18.883476 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-219a44a3-53a8-4bb8-881a-03f88f50872e tempest-DeleteServersTestJSON-882644123 tempest-DeleteServersTestJSON-882644123-project] 10.222.0.25 "GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1" status: 404 len: 111 microversion: 2.1 time: 0.057346 Sep 22 22:12:18.883476 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 192/351] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:18 2022] GET /compute/v2.1/servers/3aa42cc5-2ad6-4a5d-80b9-837cc6186ac1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 22:12:19.863510 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:19.865573 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:19.875137 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:19.875636 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:19.876202 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:19.876938 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:19.877453 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:19.878048 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:20.092937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:20.104056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e425a273-259c-4061-be32-5d64cc575dab tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.244130 Sep 22 22:12:20.114299 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 160/352] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:19 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:21.127309 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:21.127912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:21.139783 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:21.140290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:21.140730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:21.141474 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:21.141930 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:21.142359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:21.402059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:21.415296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6f87160d-f736-4628-b759-295ae2abd68e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.291799 Sep 22 22:12:21.432150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 193/353] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:21 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:22.445565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:22.446188 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:22.450619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=60 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:22.464222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:22.464222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:22.464222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:22.464222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:22.464867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:22.464867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:22.781359 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:22.793832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca050720-f7ea-4f3c-b343-2d7b30ac552f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.357692 Sep 22 22:12:22.796494 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 161/354] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:22 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:23.831403 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:23.833987 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:23.851969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:23.853624 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:23.856043 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:23.859156 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:23.860178 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:23.862176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:23.912191 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:24.149144 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:24.163128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-930a46af-9b3b-4ed3-b381-e6fa120e774c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.338676 Sep 22 22:12:24.163984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 194/355] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:23 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:25.188536 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:25.189777 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:25.197363 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:25.197947 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:25.198473 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:25.199410 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:25.199939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:25.200701 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:25.387248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:25.401535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6e9a92a2-d1a7-4af2-8ef2-ebb291670866 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.216762 Sep 22 22:12:25.402390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 162/356] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:25 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:26.427705 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:26.428442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:26.434227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:26.434709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:26.435142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:26.435822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:26.436269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:26.436719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:26.610540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:26.619888 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2d9168ce-5336-4b65-8ce9-4d0b1b1705f1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.196791 Sep 22 22:12:26.620879 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 195/357] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:26 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:27.645578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:27.646379 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:27.656854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:27.657614 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:27.658128 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:27.659060 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:27.659583 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:27.660085 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:27.835558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:27.843398 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ea2b0825-530e-495d-b0b2-ac59125a4edf tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.201660 Sep 22 22:12:27.843977 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 163/358] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:27 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:28.868787 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:28.869645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:28.877676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:28.878358 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:28.878957 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:28.880450 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:28.881069 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:28.881859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:29.052227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:29.077746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-109c6dde-f57c-47cb-aae7-c9629238cb44 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.214483 Sep 22 22:12:29.078538 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 196/359] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:28 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:30.092026 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-adfe5dd7-6fcf-4384-80ea-09e6cc973b28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'create', calling method: .version_select at 0x7f405ce26ee0>, body: {"keypair": {"name": "tempest-keypair-1480948822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDX5ANHRAZkbgMF42+NrUiseDWPACdfxGH4UjbbwQBLRVD5jFWFlec+5q4tm6Ia66c3dtrJ7zgS00fOBZmIVwmu7wqrPyI1oOUzGpW+aYgO1maVPaPBy8Y6VkzI43hqoA=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:30.102220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:30.102977 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:30.117080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:30.120137 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:30.120876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:30.122015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-adfe5dd7-6fcf-4384-80ea-09e6cc973b28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Getting quotas for project 650863eae15e4733b50e22c7595d7742. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:12:30.122988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:30.124197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:30.125734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:30.128265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-adfe5dd7-6fcf-4384-80ea-09e6cc973b28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Getting quotas for user 62e294148e14459a96190fab931d4898 and project 650863eae15e4733b50e22c7595d7742. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:12:30.201547 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-adfe5dd7-6fcf-4384-80ea-09e6cc973b28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.295452 Sep 22 22:12:30.202746 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 164/360] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:12:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:12:30.347934 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:30.357663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-73918ff7-dd7b-4351-8ca7-95e8a9b1ad1a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.260420 Sep 22 22:12:30.359703 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 197/361] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:30 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:31.385539 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:31.386170 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:31.393882 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:31.394383 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:31.394858 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:31.395577 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:31.396426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:31.396929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:31.650356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:31.660730 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b32109c6-c8d2-4f0b-89f6-f7e900acfe73 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.280460 Sep 22 22:12:31.662040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 165/362] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:31 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:32.007344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1744715893", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c3478bc-b7f3-4988-80ed-a5eadeacc461"}], "security_groups": [{"name": "tempest-securitygroup--910097283"}], "key_name": "tempest-keypair-1480948822", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:32.123978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] validate_networks() for [('5c3478bc-b7f3-4988-80ed-a5eadeacc461', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:12:32.520849 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:12:32.521742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:12:32.522676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:12:32.523088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:12:32.523500 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:12:32.532496 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:32.532914 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:32.533449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:32.534176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:32.534632 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:32.535063 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:32.552854 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Getting quotas for project 650863eae15e4733b50e22c7595d7742. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:12:32.556804 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Getting quotas for user 62e294148e14459a96190fab931d4898 and project 650863eae15e4733b50e22c7595d7742. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:12:32.568591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:12:32.571029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:12:32.622566 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1f5b9e46-2b55-4c61-a77b-af4e64dcd44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.620235 Sep 22 22:12:32.623567 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 198/363] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:12:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:12:32.637807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0bc0cf8-cf40-4849-90a6-bd298335c289 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:32.637807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0bc0cf8-cf40-4849-90a6-bd298335c289 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:32.687361 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:32.688241 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:32.696826 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:32.697614 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:32.698231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:32.699098 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:32.700035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:32.700623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:32.705348 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0bc0cf8-cf40-4849-90a6-bd298335c289 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:32.714493 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0bc0cf8-cf40-4849-90a6-bd298335c289 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1238 microversion: 2.1 time: 0.082616 Sep 22 22:12:32.717933 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 166/364] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:32 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:32.858740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:32.868609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-41b705d7-5757-42fa-a5a9-342873c65d7c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.185202 Sep 22 22:12:32.869279 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 199/365] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:32 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:33.742379 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:33.742990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:33.757328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:33.758525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:33.759424 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:33.760478 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:33.760941 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:33.761389 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:33.849535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:33.858068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0944da24-2bb0-460b-9355-4fe74c1b48e8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1242 microversion: 2.1 time: 0.119825 Sep 22 22:12:33.859216 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 167/366] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:33 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:33.891769 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:33.892390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:33.900561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:33.901066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:33.901543 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:33.902252 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:33.902714 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:33.903212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:34.047189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:34.056859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-360a9ec3-98cf-4b58-9ba3-4f7c7ae98bb3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1521 microversion: 2.1 time: 0.168912 Sep 22 22:12:34.062074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 200/367] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:33 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:34.883561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:34.884334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:34.908098 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:34.908798 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:34.909434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:34.910307 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:34.912378 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:34.912841 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:34.985888 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:34.994356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b9677e31-09f6-40b4-83a0-fd34b1dc3eeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1234 microversion: 2.1 time: 0.115519 Sep 22 22:12:34.996082 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 168/368] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:34 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1234 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:35.083372 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:35.084020 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:35.089935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:35.090420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:35.090856 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:35.091561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:35.092014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:35.092480 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:35.237423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:35.245739 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c3d53675-1343-480b-b55a-a1e15f69e7f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1501 microversion: 2.1 time: 0.166720 Sep 22 22:12:35.246309 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 201/369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:35 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:35.272550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:35.273223 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:35.279101 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:35.279581 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:35.280013 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:35.280699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:35.281175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:35.281599 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:35.440386 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:35.557847 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:35.566265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6434b96f-4515-44ea-b697-3abc4de1174c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1516 microversion: 2.1 time: 0.298240 Sep 22 22:12:35.567570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 169/370] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:35 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1516 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:36.019385 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:36.020767 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:36.026839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:36.027347 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:36.027826 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:36.028586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:36.029073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:36.029513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:36.097599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:36.105372 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7f881bc2-3d2c-4c80-90af-c4c4d383f10f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1290 microversion: 2.1 time: 0.089807 Sep 22 22:12:36.105929 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 202/371] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:36 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:37.127739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:37.128341 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:37.134909 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:37.135388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:37.135814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:37.136492 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:37.136936 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:37.137376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:37.201547 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:37.209512 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2c13d836-a764-416c-86fe-3e2b253389c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1290 microversion: 2.1 time: 0.085593 Sep 22 22:12:37.210063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 170/372] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:37 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:38.234125 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:38.234876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:38.241768 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:38.242246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:38.242677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:38.243356 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:38.243805 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:38.244218 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:38.306830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:38.314492 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7b68930d-b653-467c-9f6b-913705818e7d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1290 microversion: 2.1 time: 0.084677 Sep 22 22:12:38.315044 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 203/373] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:38 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:39.337334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:39.337952 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:39.344004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:39.344477 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:39.344906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:39.345627 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:39.346062 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:39.346478 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:39.407211 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:39.414830 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3658f740-5c4c-456e-b763-b4b1903841a6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1290 microversion: 2.1 time: 0.081348 Sep 22 22:12:39.415387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 171/374] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:39 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:40.438295 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:40.438906 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:40.445502 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:40.445993 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:40.446428 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:40.447122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:40.447570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:40.447992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:40.515186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:40.523385 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3676d7f4-d1e1-4830-b69c-c80d57f4550f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1296 microversion: 2.1 time: 0.088897 Sep 22 22:12:40.523961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 204/375] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:40 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:41.547779 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:41.548457 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:41.556178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:41.556662 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:41.557094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:41.557803 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:41.558253 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:41.558698 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:41.639163 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-40069299-446a-41ef-a710-0fefdc88069b req-bcea9a38-a26a-475e-b23b-93977b598c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8", "tag": "3ab370e5-8611-4fef-bf09-955dd5a94603"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:41.645587 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:41.651292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-40069299-446a-41ef-a710-0fefdc88069b req-bcea9a38-a26a-475e-b23b-93977b598c10 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:41.652175 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-40069299-446a-41ef-a710-0fefdc88069b req-bcea9a38-a26a-475e-b23b-93977b598c10 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:41.652670 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-40069299-446a-41ef-a710-0fefdc88069b req-bcea9a38-a26a-475e-b23b-93977b598c10 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:41.682886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-40069299-446a-41ef-a710-0fefdc88069b req-bcea9a38-a26a-475e-b23b-93977b598c10 service nova] Creating event network-changed:3ab370e5-8611-4fef-bf09-955dd5a94603 for instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 on hv-cinder-84914 Sep 22 22:12:41.698117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-40069299-446a-41ef-a710-0fefdc88069b req-bcea9a38-a26a-475e-b23b-93977b598c10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063048 Sep 22 22:12:41.699834 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 205/376] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:12:41.759443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:41.767137 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-62919dc4-b0d7-4ec5-bcb4-60e0adce83bb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.223398 Sep 22 22:12:41.767708 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 172/377] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:41 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:42.354076 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:42.384375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:42.405280 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:42.406070 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:42.409920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:42.410915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:42.411392 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:42.411827 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:42.468150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lazy-loading 'flavor' on Instance uuid 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:12:42.542088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:42.554268 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-aa596202-1d9c-44f8-8104-0e5a3e52354b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b/action" status: 200 len: 32 microversion: 2.1 time: 0.206092 Sep 22 22:12:42.554888 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 206/378] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:12:42 2022] POST /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 22:12:42.565755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:42.567318 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:42.578314 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:42.578811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:42.579253 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:42.579960 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:42.580526 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:42.580830 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:42.710648 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:42.791378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:42.792742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:42.795565 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:42.804018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:42.804812 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:42.805286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:42.806133 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:42.806784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:42.807203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:42.827400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:42.836773 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-50ee1b01-9f4f-4b70-866c-83fd76b94d4d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.275597 Sep 22 22:12:42.837398 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 173/379] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:42 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:42.955728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:42.964488 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-914b1a26-3ffc-48d6-8842-2aaf08ff7f17 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.177478 Sep 22 22:12:42.964997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 207/380] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:42 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:43.862408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:43.862945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:43.869595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:43.870084 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:43.870522 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:43.871211 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:43.871667 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:43.872155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:43.986953 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:43.987628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:43.993746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:43.994226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:43.994656 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:43.995345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:43.995789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:43.996201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:44.006716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:44.014451 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c98dad15-d3a6-43fc-9a0e-f24101c50288 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.156424 Sep 22 22:12:44.015092 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 174/381] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:43 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:44.134061 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:44.141739 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b3134165-2c48-4573-a3cd-07ffcd8b8161 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.158598 Sep 22 22:12:44.142298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 208/382] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:43 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:45.039804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:45.040441 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:45.049001 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:45.049517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:45.049950 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:45.050637 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:45.052003 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:45.052629 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:45.164225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:45.164827 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:45.170735 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:45.171224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:45.171658 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:45.172341 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:45.172791 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:45.173239 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:45.190563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:45.202340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9e06431c-319f-45d0-bb4d-9db7ed446bff tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.168069 Sep 22 22:12:45.203008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 175/383] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:45 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:45.309377 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:45.316934 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b1e370f8-2afc-420b-9637-b4142d05b35d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.157083 Sep 22 22:12:45.317845 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 209/384] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:45 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:46.226147 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:46.226758 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:46.233140 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:46.233631 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:46.234068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:46.234883 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:46.235246 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:46.235872 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:46.340481 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:46.341304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:46.348071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:46.348861 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:46.349916 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:46.351120 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:46.351715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:46.352375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:46.376373 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:46.656861 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:46.666225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-48a60cda-ea19-4a39-ab35-78913e14727b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.444028 Sep 22 22:12:46.666819 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 176/385] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:46 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:46.780764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:46.792596 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-54e765be-e62c-4ef3-bee9-5d09f081abb8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.455323 Sep 22 22:12:46.793181 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 210/386] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:46 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:12:47.689919 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:47.690565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:47.698070 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:47.698557 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:47.698996 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:47.699688 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:47.700143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:47.700599 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:47.819658 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:47.820189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:47.827857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:47.828676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:47.829293 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:47.830146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:47.830752 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:47.831349 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:47.851871 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:47.861138 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-242325e6-cdd8-4f07-ad95-fcae25d499ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.174976 Sep 22 22:12:47.862283 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 177/387] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:47 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:48.074535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:48.086895 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8dd350f4-342f-458a-b0b2-4093823549a2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.271571 Sep 22 22:12:48.087924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 211/388] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:47 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:48.885952 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:48.886502 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:48.892858 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:48.893372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:48.893809 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:48.894494 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:48.895586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:48.896008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:49.021957 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:49.029526 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3db084b7-254a-4f2b-bfdd-8efd8be98714 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.147538 Sep 22 22:12:49.030093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 178/389] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:48 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:49.111533 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:49.112138 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:49.118673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:49.119146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:49.119578 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:49.120258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:49.120710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:49.121150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:49.246183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:49.254137 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bc039b0c-ac76-4044-92bb-e5086050e19e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.146442 Sep 22 22:12:49.254697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 212/390] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:49 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:50.052001 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:50.052614 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:50.059161 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:50.059458 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:50.059887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:50.060567 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:50.061015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:50.061465 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:50.192372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:50.199885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-492e5c2e-4746-4013-9d61-f4a5e9d1c6e9 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.152047 Sep 22 22:12:50.200439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 179/391] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:50 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:50.276613 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:50.277922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:50.284171 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:50.284654 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:50.285090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:50.285844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:50.286302 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:50.286728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:50.415970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:50.423528 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0707abda-1285-4002-90ad-6f4daefd187e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.150908 Sep 22 22:12:50.424080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 213/392] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:50 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:51.223686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:51.224321 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:51.230704 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:51.231182 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:51.231618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:51.232335 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:51.232787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:51.233234 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:51.367850 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:51.375392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-364ee9e1-9088-4b75-a583-2ccb02256cd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.156137 Sep 22 22:12:51.375953 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 180/393] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:51 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:51.446845 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:51.447373 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:51.453342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:51.453831 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:51.454267 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:51.454959 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:51.455417 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:51.455842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:51.581576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:51.589640 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9409e1ae-0f01-418f-aa80-391411a459fa tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.146708 Sep 22 22:12:51.590200 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 214/394] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:51 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:52.398296 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:52.398919 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:52.405574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:52.406046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:52.406474 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:52.407148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:52.407617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:52.408014 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:52.541786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:52.549492 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a21e53ba-a79e-4775-9d16-ac2f3622236c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.155416 Sep 22 22:12:52.550056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 181/395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:52 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:52.612180 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:52.612721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:52.619358 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:52.619875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:52.620305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:52.620985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:52.621465 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:52.621919 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:52.750329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:52.757898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b5d6f345-2c4d-4b82-b427-b155fc72fdd4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.149564 Sep 22 22:12:52.758462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 215/396] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:52 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:53.377810 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-d8b406f1-3dfd-495d-a22b-6e816fd8f59f req-6e574ad4-0010-4598-892f-0425c623fc02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8", "name": "network-vif-plugged", "status": "completed", "tag": "3ab370e5-8611-4fef-bf09-955dd5a94603"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:53.383366 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:53.396158 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d8b406f1-3dfd-495d-a22b-6e816fd8f59f req-6e574ad4-0010-4598-892f-0425c623fc02 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:53.396640 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d8b406f1-3dfd-495d-a22b-6e816fd8f59f req-6e574ad4-0010-4598-892f-0425c623fc02 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:53.397071 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-d8b406f1-3dfd-495d-a22b-6e816fd8f59f req-6e574ad4-0010-4598-892f-0425c623fc02 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:53.409210 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-d8b406f1-3dfd-495d-a22b-6e816fd8f59f req-6e574ad4-0010-4598-892f-0425c623fc02 service nova] Creating event network-vif-plugged:3ab370e5-8611-4fef-bf09-955dd5a94603 for instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 on hv-cinder-84914 Sep 22 22:12:53.414502 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-d8b406f1-3dfd-495d-a22b-6e816fd8f59f req-6e574ad4-0010-4598-892f-0425c623fc02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040267 Sep 22 22:12:53.415321 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 182/397] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:12:53.573398 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:53.574000 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:53.580067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:53.580532 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:53.580961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:53.581667 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:53.582164 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:53.582588 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:53.715541 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:53.724312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-49251434-6973-4318-b8db-916c4f3c23f6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.154568 Sep 22 22:12:53.724956 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 216/398] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:53 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:53.780341 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:53.781040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:53.787244 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:53.787737 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:53.788175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:53.788871 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:53.789363 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:53.789794 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:53.950844 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:53.958965 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-878c4e24-e544-4131-87c3-24de41b6e51a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.182939 Sep 22 22:12:53.959524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 183/399] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:53 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:54.749809 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:54.750533 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:54.756787 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:54.757385 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:54.757817 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:54.758500 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:54.758948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:54.759366 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:54.895465 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:54.903176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-027a1f98-dde2-4e13-9660-14d207e8ddd7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.157233 Sep 22 22:12:54.903741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 217/400] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:54 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:54.982275 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:54.982881 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:54.989216 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:54.989703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:54.990137 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:54.990822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:54.991282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:54.991701 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:55.125575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:55.134018 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4a67482e-8041-47db-a9ae-61376224dace tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.155584 Sep 22 22:12:55.134580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 184/401] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:54 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:55.927245 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:55.927918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:55.934457 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:55.934937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:55.935384 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:55.936061 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:55.936511 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:55.936931 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:56.098462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:56.107933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-045885bc-6b65-433e-8c03-028f71a391a3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.185203 Sep 22 22:12:56.108646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 218/402] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:55 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:56.157562 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:56.158173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:56.167868 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:56.168429 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:56.169219 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:56.170222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:56.170836 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:56.171846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:56.373742 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:56.382640 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c8d9938e-cd51-4b1d-a7d6-ce547f4173e0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1363 microversion: 2.1 time: 0.229596 Sep 22 22:12:56.383222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 185/403] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:56 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:57.132500 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:57.133129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:57.139067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:57.139554 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:57.139992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:57.140682 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:57.141160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:57.141594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:57.271158 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:57.278947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-756765a6-6529-4719-a969-a149e0cef409 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.150934 Sep 22 22:12:57.279520 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 219/404] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:57 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:57.405220 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:57.405927 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:57.412304 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:57.412788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:57.413256 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:57.413941 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:57.414398 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:57.414817 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:57.764610 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:57.768152 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:12:57.773059 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-da696172-ac87-4529-b333-a6a697edf48a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1549 microversion: 2.1 time: 0.371746 Sep 22 22:12:57.773654 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 186/405] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:57 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1549 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:57.796450 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e2e9fcaa-8c6a-4d9c-8903-f7e2e1aa1530 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:57.796939 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e2e9fcaa-8c6a-4d9c-8903-f7e2e1aa1530 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:57.803709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e9fcaa-8c6a-4d9c-8903-f7e2e1aa1530 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:57.804129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e9fcaa-8c6a-4d9c-8903-f7e2e1aa1530 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:57.804566 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e9fcaa-8c6a-4d9c-8903-f7e2e1aa1530 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:57.805293 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e9fcaa-8c6a-4d9c-8903-f7e2e1aa1530 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:57.805746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e9fcaa-8c6a-4d9c-8903-f7e2e1aa1530 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:57.806167 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e9fcaa-8c6a-4d9c-8903-f7e2e1aa1530 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:57.885336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e2e9fcaa-8c6a-4d9c-8903-f7e2e1aa1530 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092754 Sep 22 22:12:57.885956 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 220/406] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 22 22:12:57 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:12:58.303172 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:58.303910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:58.310004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:58.310429 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:58.310867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:58.311595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:58.312020 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:58.312446 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:58.568284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:58.582420 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b5c268de-2466-444d-8bdf-fc1796adff91 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.283489 Sep 22 22:12:58.583362 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 187/407] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:58 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:12:58.960284 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-8e829d07-cb32-4a56-a8d2-e4896b5922be req-b04e5920-e0ff-4d70-a197-ddea31737e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8", "tag": "3ab370e5-8611-4fef-bf09-955dd5a94603"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:58.972554 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-8e829d07-cb32-4a56-a8d2-e4896b5922be req-b04e5920-e0ff-4d70-a197-ddea31737e70 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:58.973396 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-8e829d07-cb32-4a56-a8d2-e4896b5922be req-b04e5920-e0ff-4d70-a197-ddea31737e70 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:58.973834 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-8e829d07-cb32-4a56-a8d2-e4896b5922be req-b04e5920-e0ff-4d70-a197-ddea31737e70 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:58.986057 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-8e829d07-cb32-4a56-a8d2-e4896b5922be req-b04e5920-e0ff-4d70-a197-ddea31737e70 service nova] Creating event network-changed:3ab370e5-8611-4fef-bf09-955dd5a94603 for instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 on hv-cinder-84914 Sep 22 22:12:58.992493 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-8e829d07-cb32-4a56-a8d2-e4896b5922be req-b04e5920-e0ff-4d70-a197-ddea31737e70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036096 Sep 22 22:12:58.994051 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 221/408] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:12:59.227821 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6fabbb44-dd29-4321-8133-50169ee520de tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2c0cba9-7041-4546-b193-5b59536e3f20", "device": "/dev/sdb"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:12:59.230815 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6fabbb44-dd29-4321-8133-50169ee520de tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:59.236908 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6fabbb44-dd29-4321-8133-50169ee520de tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:59.237417 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6fabbb44-dd29-4321-8133-50169ee520de tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:59.237949 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6fabbb44-dd29-4321-8133-50169ee520de tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:59.238786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6fabbb44-dd29-4321-8133-50169ee520de tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:59.239331 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6fabbb44-dd29-4321-8133-50169ee520de tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:59.239748 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6fabbb44-dd29-4321-8133-50169ee520de tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:59.606842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:12:59.607537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:12:59.614557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:59.615040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:59.615469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:59.616154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:12:59.616598 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:12:59.617036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:12:59.758924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:12:59.767667 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dc4a9a16-1b2e-4ca9-a785-10fbbb3215fc tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.164946 Sep 22 22:12:59.768303 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 222/409] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:12:59 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:13:00.791804 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:00.792422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:00.801670 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:00.809669 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:00.810316 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:00.811198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:00.811748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:00.812313 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:01.002736 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6fabbb44-dd29-4321-8133-50169ee520de tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "POST /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.778623 Sep 22 22:13:01.009722 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 188/410] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:12:59 2022] POST /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030/os-volume_attachments => generated 194 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:13:01.408589 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:01.417679 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-36de01eb-7b64-4e68-b180-7ca8403a8011 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.629920 Sep 22 22:13:01.418251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 223/411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:00 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:13:02.442925 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:02.443734 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:02.450208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:02.451088 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:02.451666 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:02.452525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:02.453144 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:02.453714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:02.633982 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:02.642611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dafbd5b8-9f6f-4dd4-830f-55ad66e3f38b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.204840 Sep 22 22:13:02.643349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 189/412] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:02 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:13:03.667093 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:03.667646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:03.673713 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:03.674199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:03.674633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:03.675646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:03.676121 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:03.676524 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:03.838353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:03.853625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3e6e7e5f-3b8d-425d-b65d-f9fb2c0bc113 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1502 microversion: 2.1 time: 0.190106 Sep 22 22:13:03.854828 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 224/413] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:03 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:03.880240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7fdf790-f239-470a-9be1-f3436055bd59"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:13:03.882731 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:03.891027 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:03.891574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:03.892103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:03.892814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:03.893480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:03.894857 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:03.921525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] HTTP exception thrown: Cannot 'attach_volume' instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b while it is in vm_state rescued Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Request method failure captured: Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b/os-volume_attachments HTTP/1.1 Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 74 Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1MwaNckOyBXrl2li1Wzti5__EIIu_hQ71URQjXNxaSZLgxsPx47PdZhEErbdvvOH1NrgTqx4PXvZ3GkkpZIv1qXRWw76GInH6xlbrSFAXJ957yGl9VLt68K55_b1yCGudQh9z-LJZ0LUKJIFYiuxgvsttGS5_gwxD9er05GWlixn4 Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:13:03.923200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0499a794df4444b594ee3126a8e210c1", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: ca01fc46c837486b808390ff0c48fa1f Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {"volumeAttachment": {"volumeId": "d7fdf790-f239-470a-9be1-f3436055bd59"}} Sep 22 22:13:03.924774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Cannot 'attach_volume' instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b while it is in vm_state rescued Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'server_id': '16b462de-3ef3-4c76-bf6c-f1ce9edcda5b', 'body': {'volumeAttachment': {'volumeId': 'd7fdf790-f239-470a-9be1-f3436055bd59'}}} Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:13:03.926508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b while it is in vm_state rescued Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:13:03.929081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:13:03.931681 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:13:03.931681 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:13:03.931681 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b while it is in vm_state rescued Sep 22 22:13:03.931681 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:03.931681 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Returning 409 to user: Cannot 'attach_volume' instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b while it is in vm_state rescued {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:13:03.931681 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6c0163df-f246-417d-b01d-9c7dd87ba231 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049165 Sep 22 22:13:03.933354 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 190/414] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:13:03 2022] POST /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 22 22:13:03.934537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8297145f-e3cc-4509-986b-379dc954356e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:13:03.935070 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8297145f-e3cc-4509-986b-379dc954356e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:03.941872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8297145f-e3cc-4509-986b-379dc954356e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:03.942391 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8297145f-e3cc-4509-986b-379dc954356e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:03.943446 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8297145f-e3cc-4509-986b-379dc954356e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:03.943583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8297145f-e3cc-4509-986b-379dc954356e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:03.943925 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8297145f-e3cc-4509-986b-379dc954356e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:03.944343 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8297145f-e3cc-4509-986b-379dc954356e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:04.015657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8297145f-e3cc-4509-986b-379dc954356e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b/action" status: 202 len: 0 microversion: 2.1 time: 0.085223 Sep 22 22:13:04.016522 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 225/415] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:13:03 2022] POST /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 22:13:04.025692 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:04.026448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:04.033043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:04.033591 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:04.034741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:04.035462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:04.036056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:04.036482 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:04.173736 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:04.181936 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8de42f9d-cc1c-4264-be41-b1fe8bfe2c3c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1510 microversion: 2.1 time: 0.160603 Sep 22 22:13:04.182508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 191/416] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:04 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:05.206642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:05.207329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:05.213464 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:05.213946 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:05.214382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:05.215065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:05.215519 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:05.215942 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:05.344910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:05.353466 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-64450456-4a9c-4540-8977-90e1dae85c56 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1510 microversion: 2.1 time: 0.151114 Sep 22 22:13:05.354021 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 226/417] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:05 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:06.376959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:06.377590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:06.383922 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:06.384405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:06.384833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:06.385550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:06.386003 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:06.386447 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:06.511418 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:06.519728 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0ee59d76-5021-4daa-8002-ace1ac33d742 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1510 microversion: 2.1 time: 0.146578 Sep 22 22:13:06.520300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 192/418] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:06 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:07.543675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:07.548014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:07.554524 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:07.555025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:07.555465 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:07.556210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:07.556674 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:07.557574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:07.562435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:07.766740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:07.775317 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ba67a241-7398-4c19-8204-902253823798 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1510 microversion: 2.1 time: 0.235798 Sep 22 22:13:07.775888 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 227/419] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:07 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:08.799715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:08.800572 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:08.807284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:08.807765 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:08.808192 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:08.808872 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:08.809351 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:08.809768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:08.946924 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:08.954624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-103e873d-0607-41bf-bf0e-7a5c12d09ebe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1510 microversion: 2.1 time: 0.158824 Sep 22 22:13:08.955185 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 193/420] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:08 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:09.979671 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:09.980192 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:09.986109 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:09.986598 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:09.987030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:09.987737 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:09.988186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:09.988607 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:10.121039 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:10.129825 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e4fbc337-76f7-4c9a-8619-45f9857e954e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1510 microversion: 2.1 time: 0.154025 Sep 22 22:13:10.130398 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 228/421] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:09 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:11.154325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:11.154947 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:11.162112 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:11.162596 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:11.163025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:11.163707 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:11.164159 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:11.164580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:11.289059 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:11.296625 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f1692b96-487d-4a79-b304-97ea607ee092 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1516 microversion: 2.1 time: 0.146171 Sep 22 22:13:11.297205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 194/422] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:11 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1516 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:12.646706 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1b1b74fb-79f4-411c-888d-bf9fc276a83f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'create', calling method: .version_select at 0x7f405cc7c160>, body: {"keypair": {"name": "tempest-keypair-1772039435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV4xNfPOz7e0eWT4q84IjCUybO/UVNebJwharHwdgtDqO/j/NJfWV9rGVfmQWhzXCmigFJdxkvzl5TbPvaO4X5j97ja53EpGWYQu16PkSDfhW3u+MDcdkdyAZrEsRjSqQ=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:13:12.651982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=48 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:12.663828 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-1b1b74fb-79f4-411c-888d-bf9fc276a83f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Getting quotas for project 0499a794df4444b594ee3126a8e210c1. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:13:12.667578 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-1b1b74fb-79f4-411c-888d-bf9fc276a83f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Getting quotas for user ca01fc46c837486b808390ff0c48fa1f and project 0499a794df4444b594ee3126a8e210c1. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:13:12.689265 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1b1b74fb-79f4-411c-888d-bf9fc276a83f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047073 Sep 22 22:13:12.690381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 229/423] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:13:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:13:14.211468 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-344478585", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "770f63d9-fbe3-4433-90af-714bf608e28c"}], "security_groups": [{"name": "tempest-securitygroup--1308718656"}], "key_name": "tempest-keypair-1772039435", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:13:14.316597 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] validate_networks() for [('770f63d9-fbe3-4433-90af-714bf608e28c', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:13:14.692258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:13:14.692682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:13:14.693202 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:13:14.693668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:13:14.694080 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:13:14.702745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:14.703217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:14.703646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:14.704365 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:14.704808 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:14.705257 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:14.722651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Getting quotas for project 0499a794df4444b594ee3126a8e210c1. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:13:14.726531 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Getting quotas for user ca01fc46c837486b808390ff0c48fa1f and project 0499a794df4444b594ee3126a8e210c1. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:13:14.737337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:13:14.739589 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:13:14.787432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ab7439e3-9c91-4fa0-a50d-eb71d71f5cbb tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.580283 Sep 22 22:13:14.788073 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 195/424] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:13:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:13:14.801940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b992a6fc-021c-47fe-9d77-8794daebb854 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:14.802620 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b992a6fc-021c-47fe-9d77-8794daebb854 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:14.871240 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b992a6fc-021c-47fe-9d77-8794daebb854 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:14.872300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b992a6fc-021c-47fe-9d77-8794daebb854 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1245 microversion: 2.1 time: 0.076284 Sep 22 22:13:14.872916 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 230/425] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:14 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:15.895386 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:15.895991 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:15.902022 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:15.902502 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:15.902941 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:15.903621 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:15.904073 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:15.904493 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:15.964461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:15.972405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c23715ef-dc40-4f9a-a8a1-7ab73ab8ede8 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1249 microversion: 2.1 time: 0.082033 Sep 22 22:13:15.972970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 196/426] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:15 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:16.995551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:16.996085 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:17.003005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:17.003483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:17.003912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:17.004591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:17.005037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:17.005476 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:17.067142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:17.074782 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3905c4a7-1364-4d94-a42c-9b84b6529235 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1249 microversion: 2.1 time: 0.083181 Sep 22 22:13:17.075335 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 231/427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:16 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:18.098006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:18.098571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:18.104946 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:18.105456 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:18.105892 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:18.106585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:18.107043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:18.107468 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:18.217781 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:18.245641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f7adb050-afde-4f60-b529-97c3a724d6fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1297 microversion: 2.1 time: 0.149533 Sep 22 22:13:18.247636 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 197/428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:18 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:19.274882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:19.275587 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:19.281882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:19.282365 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:19.282800 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:19.284336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:19.284789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:19.285239 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:19.418503 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:19.426634 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-139fab37-4b06-415e-87e2-9b766f9c2a77 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.155751 Sep 22 22:13:19.427194 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 232/429] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:19 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:20.450284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:20.450916 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:20.457244 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:20.457724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:20.458154 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:20.458832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:20.459278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:20.459695 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:20.585902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:20.593330 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-28aef12e-baa4-4bf6-8e03-634353cea390 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.146873 Sep 22 22:13:20.593882 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 198/430] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:20 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:21.615620 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:21.616219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:21.622069 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:21.622525 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:21.622955 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:21.623631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:21.624077 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:21.624493 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:21.748886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:21.757067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-84e87ae9-a02f-4a07-a01b-157afe941286 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.145362 Sep 22 22:13:21.757652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 233/431] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:21 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:22.779662 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:22.780260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:22.787236 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:22.787714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:22.788145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:22.788822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:22.789303 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:22.789726 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:22.920242 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:22.928274 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b782bf46-407d-4d7b-a04b-6ed4389c9389 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.152417 Sep 22 22:13:22.928836 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 199/432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:22 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:23.652219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-3d19e6f0-4ead-40b3-a82c-e3773bbf7dc0 req-4a211711-6695-4368-9255-bb7f89f07c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508fe0c2-63f2-443d-b1a6-594aac42f259", "tag": "afcd99bc-64da-4e1a-855a-3858543e6931"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:13:23.665203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3d19e6f0-4ead-40b3-a82c-e3773bbf7dc0 req-4a211711-6695-4368-9255-bb7f89f07c8d service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:23.665765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3d19e6f0-4ead-40b3-a82c-e3773bbf7dc0 req-4a211711-6695-4368-9255-bb7f89f07c8d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:23.666272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-3d19e6f0-4ead-40b3-a82c-e3773bbf7dc0 req-4a211711-6695-4368-9255-bb7f89f07c8d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:23.679082 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-3d19e6f0-4ead-40b3-a82c-e3773bbf7dc0 req-4a211711-6695-4368-9255-bb7f89f07c8d service nova] Creating event network-changed:afcd99bc-64da-4e1a-855a-3858543e6931 for instance 508fe0c2-63f2-443d-b1a6-594aac42f259 on hv-cinder-84914 Sep 22 22:13:23.684031 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-3d19e6f0-4ead-40b3-a82c-e3773bbf7dc0 req-4a211711-6695-4368-9255-bb7f89f07c8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035765 Sep 22 22:13:23.685008 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 234/433] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:13:23.950641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:23.951248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:23.953701 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:23.961839 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:23.962326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:23.962754 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:23.963450 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:23.963900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:23.964316 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:24.189588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:24.199190 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bf6bdb55-4905-460e-b0f3-adb203811692 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.252349 Sep 22 22:13:24.200134 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 200/434] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:23 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:25.221205 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:25.226428 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:25.227117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:25.234937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:25.235355 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:25.235837 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:25.236550 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:25.237005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:25.237453 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:25.375177 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:25.383066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-713669fa-e638-45fa-a822-f5bed21d0fee tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.163864 Sep 22 22:13:25.383623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 235/435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:25 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:26.408058 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:26.408668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:26.410625 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:26.411272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:26.417343 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:26.417822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:26.418246 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:26.418939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:26.419389 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:26.419809 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:26.552865 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:26.560574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-41916e87-2b97-48e6-9f6c-09b53e3e43a7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.156847 Sep 22 22:13:26.561176 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 201/436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:26 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:27.584279 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:27.584922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:27.591171 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:27.591676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:27.592112 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:27.592838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:27.593361 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:27.593815 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:27.730857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:27.738845 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6a79e59b-7055-4d5d-90f0-4ecf98b274aa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.159197 Sep 22 22:13:27.739406 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 236/437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:27 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:28.763259 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:28.763873 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:28.771010 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:28.771496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:28.771933 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:28.772622 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:28.773081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:28.773535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:28.776048 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:28.906108 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:28.913714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-da040243-de4b-4d14-88bb-eb16eecfba6d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.154350 Sep 22 22:13:28.914278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 202/438] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:28 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:29.936940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:29.937562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:29.943516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:29.943994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:29.944428 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:29.945129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:29.945586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:29.946007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:30.074630 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:30.083430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a6434830-03d8-4905-8e22-57304eaa2bb6 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.150309 Sep 22 22:13:30.083996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 237/439] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:29 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:31.106679 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:31.107288 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:31.114443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:31.114929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:31.115371 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:31.116060 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:31.116517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:31.116947 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:31.245997 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:31.254101 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bc53f154-ca51-43ed-8137-6b5564f6de14 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.151303 Sep 22 22:13:31.254671 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 203/440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:31 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:32.275960 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:32.276591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:32.283250 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:32.283750 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:32.284182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:32.284918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:32.285430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:32.285855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:32.418733 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:32.428351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-86e34e95-5a0b-4375-a1bf-7ae96b3e104c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.156129 Sep 22 22:13:32.428933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 238/441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:32 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:33.454488 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:33.455996 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:33.462769 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:33.463263 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:33.463700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:33.464464 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:33.464954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:33.465409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:33.612990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:33.623661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-93e30c91-992e-41ba-ae8b-bedebd59ef78 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.175653 Sep 22 22:13:33.624787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 204/442] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:33 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:34.647428 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:34.649011 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:34.655489 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:34.656172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:34.656671 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:34.658120 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:34.658573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:34.659012 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:34.806152 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:34.815090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1e660a42-6254-48a6-b03e-b0ab05fc021c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.171545 Sep 22 22:13:34.815984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 239/443] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:34 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:35.429755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:35.430320 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:35.437289 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:35.437772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:35.438711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:35.439498 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:35.440159 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:35.440443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:35.571217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lazy-loading 'services' on Instance uuid 2db03f26-beec-4475-8f6d-395416d4a030 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:13:35.699800 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e3c3273c-3365-4826-9377-f922d5374016 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030/os-volume_attachments/d2c0cba9-7041-4546-b193-5b59536e3f20" status: 202 len: 0 microversion: 2.1 time: 0.273852 Sep 22 22:13:35.700448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 205/444] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:13:35 2022] DELETE /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030/os-volume_attachments/d2c0cba9-7041-4546-b193-5b59536e3f20 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:13:35.839596 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:35.840212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:35.847630 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:35.848128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:35.848566 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:35.849528 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:35.850221 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:35.850717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:35.983646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:35.991649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-48210560-56b5-4f99-92ad-8b6004e75167 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.155815 Sep 22 22:13:35.992224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 240/445] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:35 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:37.016086 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:37.016964 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:37.023316 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:37.023737 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:37.024167 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:37.024847 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:37.025330 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:37.025751 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:37.413278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:37.421708 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9dc9a4a3-e6d6-4f96-9e60-bbfffc40bb34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.410340 Sep 22 22:13:37.422710 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 206/446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:37 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:37.906376 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:37.909165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:37.919696 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:37.921207 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:37.921819 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:37.923288 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:37.924824 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:37.927128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:37.934211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=67 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:37.975857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:13:38.072746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0d8807b4-cf94-4766-9a5b-0bc53b217f54 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 204 len: 0 microversion: 2.1 time: 0.173115 Sep 22 22:13:38.073771 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 241/447] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:13:37 2022] DELETE /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:13:38.083328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:38.084056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:38.091589 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:38.092170 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:38.092674 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:38.093480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:38.094005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:38.094542 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:38.230618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:38.240434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0ed5b93c-6068-4b94-a88f-b600cf1cf6c6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1513 microversion: 2.1 time: 0.161867 Sep 22 22:13:38.241051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 207/448] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:38 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:13:38.448395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:38.448999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:38.455059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:38.455537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:38.455966 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:38.456643 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:38.457089 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:38.457535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:38.592103 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:38.601673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-212cc5b7-e7d4-4ebf-bee4-337f65e9fdf5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.157202 Sep 22 22:13:38.602707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 242/449] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:38 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:39.262742 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:39.263349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:39.270816 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:39.271303 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:39.271742 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:39.272460 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:39.272915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:39.273362 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:39.275158 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-4864d7b2-714a-463b-9a42-6d28ad01a9a4 req-3cf3d574-4b9d-45c4-bf29-76d7909422b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508fe0c2-63f2-443d-b1a6-594aac42f259", "name": "network-vif-plugged", "status": "completed", "tag": "afcd99bc-64da-4e1a-855a-3858543e6931"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:13:39.286871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4864d7b2-714a-463b-9a42-6d28ad01a9a4 req-3cf3d574-4b9d-45c4-bf29-76d7909422b2 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:39.287353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4864d7b2-714a-463b-9a42-6d28ad01a9a4 req-3cf3d574-4b9d-45c4-bf29-76d7909422b2 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:39.287779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4864d7b2-714a-463b-9a42-6d28ad01a9a4 req-3cf3d574-4b9d-45c4-bf29-76d7909422b2 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:39.302993 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-4864d7b2-714a-463b-9a42-6d28ad01a9a4 req-3cf3d574-4b9d-45c4-bf29-76d7909422b2 service nova] Creating event network-vif-plugged:afcd99bc-64da-4e1a-855a-3858543e6931 for instance 508fe0c2-63f2-443d-b1a6-594aac42f259 on hv-cinder-84914 Sep 22 22:13:39.319046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-4864d7b2-714a-463b-9a42-6d28ad01a9a4 req-3cf3d574-4b9d-45c4-bf29-76d7909422b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047410 Sep 22 22:13:39.319648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 243/450] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:13:39.414853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:39.423409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1cc0e572-8729-47c3-8fcc-7aedbf1a7315 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1513 microversion: 2.1 time: 0.163873 Sep 22 22:13:39.424467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 208/451] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:39 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:39.632047 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:39.632690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:39.639219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:39.639702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:39.640140 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:39.640836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:39.641838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:39.642267 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:39.781334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:39.789215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c2a81618-70b4-4cd0-bf78-92ef5b687a05 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.166946 Sep 22 22:13:39.789788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 244/452] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:39 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:40.447350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:40.447913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:40.454188 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:40.454665 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:40.455092 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:40.455770 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:40.456213 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:40.456628 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:40.582789 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:40.590349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dabc3675-996a-4a03-a21a-c03df8fc9ea8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1513 microversion: 2.1 time: 0.146934 Sep 22 22:13:40.590907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 209/453] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:40 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:40.814351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:40.814973 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:40.821065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:40.821581 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:40.822020 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:40.822713 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:40.823170 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:40.823595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:40.955722 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:40.963305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-066077bb-ee6a-471d-889d-2fb5f6470f2f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1371 microversion: 2.1 time: 0.153240 Sep 22 22:13:40.963916 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 245/454] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:40 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:41.614648 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:41.615325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:41.621683 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:41.622167 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:41.622609 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:41.623300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:41.623752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:41.624171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:41.846332 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-7f0ef93f-8fd9-4aa3-b33d-459baa7436de req-ebfc722c-0526-4564-a861-9a85b1215e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db03f26-beec-4475-8f6d-395416d4a030", "name": "network-vif-deleted", "tag": "f669f0bc-c901-4213-87e9-b6ba474f53a7"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:13:41.855466 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7f0ef93f-8fd9-4aa3-b33d-459baa7436de req-ebfc722c-0526-4564-a861-9a85b1215e12 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:41.855946 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7f0ef93f-8fd9-4aa3-b33d-459baa7436de req-ebfc722c-0526-4564-a861-9a85b1215e12 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:41.856372 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-7f0ef93f-8fd9-4aa3-b33d-459baa7436de req-ebfc722c-0526-4564-a861-9a85b1215e12 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:41.857096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:41.868790 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-7f0ef93f-8fd9-4aa3-b33d-459baa7436de req-ebfc722c-0526-4564-a861-9a85b1215e12 service nova] Creating event network-vif-deleted:f669f0bc-c901-4213-87e9-b6ba474f53a7 for instance 2db03f26-beec-4475-8f6d-395416d4a030 on hv-cinder-84914 Sep 22 22:13:41.872281 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1b26a98b-16e8-4235-8c4c-c318e77422f0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1513 microversion: 2.1 time: 0.262092 Sep 22 22:13:41.872966 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 210/455] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:41 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:41.874205 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-7f0ef93f-8fd9-4aa3-b33d-459baa7436de req-ebfc722c-0526-4564-a861-9a85b1215e12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Sep 22 22:13:41.874919 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 246/456] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:13:41.987105 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:41.987787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:41.994489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:41.995061 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:41.995554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:41.996342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:41.996850 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:41.997453 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:42.165644 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:42.173463 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3ea6810d-0538-4db7-a5d3-acc105670a9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1564 microversion: 2.1 time: 0.190723 Sep 22 22:13:42.174295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 211/457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:41 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:42.197447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-29297b67-eed0-4066-b482-a5ef00d6693d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:42.198023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-29297b67-eed0-4066-b482-a5ef00d6693d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:42.204850 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29297b67-eed0-4066-b482-a5ef00d6693d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:42.205354 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29297b67-eed0-4066-b482-a5ef00d6693d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:42.205788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29297b67-eed0-4066-b482-a5ef00d6693d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:42.206466 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29297b67-eed0-4066-b482-a5ef00d6693d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:42.206918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29297b67-eed0-4066-b482-a5ef00d6693d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:42.207338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-29297b67-eed0-4066-b482-a5ef00d6693d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:42.290097 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-29297b67-eed0-4066-b482-a5ef00d6693d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096842 Sep 22 22:13:42.290689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 247/458] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 22 22:13:42 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:13:42.896041 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:42.896724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:42.903555 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:42.904055 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:42.904530 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:42.905260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:42.905745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:42.906167 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:42.942895 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:42.943381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:42.943828 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:42.944259 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lazy-loading 'fault' on Instance uuid 2db03f26-beec-4475-8f6d-395416d4a030 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:13:42.986929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:42.996192 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-85e92e69-fb22-4e36-80d8-6d5aa7953af4 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 200 len: 1308 microversion: 2.1 time: 0.103996 Sep 22 22:13:42.997451 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 212/459] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:42 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:13:43.636694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-35cff353-c8d2-436d-8cb5-4227d3677763 req-bd0e32e2-75be-4a8b-8b8d-3004a878615f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508fe0c2-63f2-443d-b1a6-594aac42f259", "tag": "afcd99bc-64da-4e1a-855a-3858543e6931"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:13:43.646167 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:43.648350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-35cff353-c8d2-436d-8cb5-4227d3677763 req-bd0e32e2-75be-4a8b-8b8d-3004a878615f service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:43.649129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-35cff353-c8d2-436d-8cb5-4227d3677763 req-bd0e32e2-75be-4a8b-8b8d-3004a878615f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:43.649774 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-35cff353-c8d2-436d-8cb5-4227d3677763 req-bd0e32e2-75be-4a8b-8b8d-3004a878615f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:43.665039 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-35cff353-c8d2-436d-8cb5-4227d3677763 req-bd0e32e2-75be-4a8b-8b8d-3004a878615f service nova] Creating event network-changed:afcd99bc-64da-4e1a-855a-3858543e6931 for instance 508fe0c2-63f2-443d-b1a6-594aac42f259 on hv-cinder-84914 Sep 22 22:13:43.670230 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-35cff353-c8d2-436d-8cb5-4227d3677763 req-bd0e32e2-75be-4a8b-8b8d-3004a878615f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037406 Sep 22 22:13:43.670925 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 248/460] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:13:44.021439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:44.022407 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 2db03f26-beec-4475-8f6d-395416d4a030] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:44.029430 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:44.030150 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:44.030784 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:44.031722 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:44.032649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:44.033319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:44.049797 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] HTTP exception thrown: Instance 2db03f26-beec-4475-8f6d-395416d4a030 could not be found. Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Request method failure captured: Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 HTTP/1.1 Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN10vEiJPb6KxQPFpPw2fehVQdQ2Ql6JDuhgPB2EA6U-4DgMOEqKKnbcDM3fKxxn_vUiOv6HSCu9HCixyL48iVUt8CJlPyooF1JSO76j4PZXXf5jkvAvWzDl1ZwZgBh8hXthYUUD1jVtrYBTebBrqbFuBBFUbZ2tXFdD_sOQpeM3YAM Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: d58361c0e40c48f4966aee3515859326 Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1070519364 Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:13:44.051889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d58361c0e40c48f4966aee3515859326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d58361c0e40c48f4966aee3515859326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d58361c0e40c48f4966aee3515859326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d58361c0e40c48f4966aee3515859326", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesSnapshotTestJSON-1070519364 Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: d58361c0e40c48f4966aee3515859326 Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1070519364 Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesSnapshotTestJSON-1070519364-project Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: cd913a3c0cff4787a90603f3afb2e883 Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesSnapshotTestJSON-1070519364-project Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 2db03f26-beec-4475-8f6d-395416d4a030 could not be found. Sep 22 22:13:44.057063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '2db03f26-beec-4475-8f6d-395416d4a030'} Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db03f26-beec-4475-8f6d-395416d4a030 could not be found. Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:13:44.058151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db03f26-beec-4475-8f6d-395416d4a030 could not be found. Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db03f26-beec-4475-8f6d-395416d4a030 could not be found. Sep 22 22:13:44.059618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:13:44.063603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Returning 404 to user: Instance 2db03f26-beec-4475-8f6d-395416d4a030 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:13:44.064578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7c70fa71-8317-4b7d-8470-cf1f007764e7 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030" status: 404 len: 111 microversion: 2.1 time: 0.048734 Sep 22 22:13:44.065169 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 213/461] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:44 2022] GET /compute/v2.1/servers/2db03f26-beec-4475-8f6d-395416d4a030 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:13:59.204274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:59.204997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:59.208997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1819430022", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "networks": [{"uuid": "ade89f04-fe3a-455d-93a5-b71450428421"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:13:59.263838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] validate_networks() for [('ade89f04-fe3a-455d-93a5-b71450428421', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:13:59.615814 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:13:59.616233 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:13:59.616698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:13:59.617139 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:13:59.617546 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:13:59.626285 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:59.626702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:59.627127 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:59.627839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:13:59.628306 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:13:59.628725 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:13:59.645386 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Getting quotas for project d58361c0e40c48f4966aee3515859326. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:13:59.649255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Getting quotas for user cd913a3c0cff4787a90603f3afb2e883 and project d58361c0e40c48f4966aee3515859326. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:13:59.661989 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:13:59.664399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:13:59.710149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1864cf71-84bc-4056-91f7-7d306c56e3ff tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506993 Sep 22 22:13:59.710762 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 249/462] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:13:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:13:59.724111 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-627486c3-2355-42b0-9a5b-8871cc20f632 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:13:59.724950 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-627486c3-2355-42b0-9a5b-8871cc20f632 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:13:59.727933 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=29 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:59.728945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:13:59.784715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-627486c3-2355-42b0-9a5b-8871cc20f632 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:13:59.792528 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-627486c3-2355-42b0-9a5b-8871cc20f632 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1219 microversion: 2.1 time: 0.074083 Sep 22 22:13:59.793406 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 214/463] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:13:59 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:00.816087 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:00.816730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:00.822968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:00.823446 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:00.823880 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:00.824565 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:00.825016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:00.825468 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:00.892124 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:00.899812 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8023ef29-78dd-4914-8f4a-598533b2c7cb tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1271 microversion: 2.1 time: 0.088100 Sep 22 22:14:00.900415 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 250/464] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:00 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:01.923684 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:01.924298 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:01.933377 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:01.934028 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:01.934470 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:01.935570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:01.936368 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:01.936957 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:02.172077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:02.180239 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-94a2dd14-f93a-44e4-a2ab-37cc99b2c529 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1319 microversion: 2.1 time: 0.260823 Sep 22 22:14:02.180816 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 215/465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:01 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:02.527822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c88e383e-2b53-4d8e-98df-9138351c6d21 req-ea55210d-972f-4de2-95f9-1a22f8c94810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049be337-3d21-42c8-97e2-46af2bdf2358", "tag": "f721a259-ddab-4029-9561-ccfde8c41208"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:14:02.537810 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c88e383e-2b53-4d8e-98df-9138351c6d21 req-ea55210d-972f-4de2-95f9-1a22f8c94810 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:02.538419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c88e383e-2b53-4d8e-98df-9138351c6d21 req-ea55210d-972f-4de2-95f9-1a22f8c94810 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:02.538945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c88e383e-2b53-4d8e-98df-9138351c6d21 req-ea55210d-972f-4de2-95f9-1a22f8c94810 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:02.552541 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c88e383e-2b53-4d8e-98df-9138351c6d21 req-ea55210d-972f-4de2-95f9-1a22f8c94810 service nova] Creating event network-changed:f721a259-ddab-4029-9561-ccfde8c41208 for instance 049be337-3d21-42c8-97e2-46af2bdf2358 on hv-cinder-84914 Sep 22 22:14:02.557628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-c88e383e-2b53-4d8e-98df-9138351c6d21 req-ea55210d-972f-4de2-95f9-1a22f8c94810 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033448 Sep 22 22:14:02.558231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 251/466] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:14:03.203658 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:03.204266 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:03.210630 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:03.211110 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:03.211543 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:03.212227 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:03.212685 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:03.213123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:03.346631 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:03.354338 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a322cbf0-993a-4606-bdd9-1bc011cdce1d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1319 microversion: 2.1 time: 0.154605 Sep 22 22:14:03.354913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 216/467] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:03 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:04.378319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:04.379011 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:04.385282 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:04.385761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:04.386189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:04.386870 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:04.387311 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:04.387726 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:04.516149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:04.523901 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-34967537-620b-4619-a9ac-0bf9a90cc865 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1319 microversion: 2.1 time: 0.150648 Sep 22 22:14:04.524501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 252/468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:04 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:05.548209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:05.548814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:05.555087 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:05.555570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:05.556004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:05.556686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:05.557158 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:05.557582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:05.685808 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:05.694025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ed16adb5-9e1c-465f-b8a4-ea6eeae4179d tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1319 microversion: 2.1 time: 0.150709 Sep 22 22:14:05.694582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 217/469] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:05 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:06.716527 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:06.717064 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:06.723284 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:06.723763 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:06.724192 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:06.724880 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:06.725365 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:06.725786 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:06.858971 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:06.866540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-57eab2f9-e314-4828-a913-c14b2e62ef33 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1319 microversion: 2.1 time: 0.154124 Sep 22 22:14:06.867096 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 253/470] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:06 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:07.890108 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:07.890881 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:07.897262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:07.897819 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:07.898324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:07.899079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:07.899600 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:07.900112 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:08.037386 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:08.045487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8018e033-23df-46e6-8496-60e440d0a113 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1319 microversion: 2.1 time: 0.159321 Sep 22 22:14:08.046719 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 218/471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:07 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:09.072041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:09.072668 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:09.079936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:09.080424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:09.080863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:09.081613 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:09.082067 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:09.082492 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:09.211125 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:09.219804 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6ef8c530-50cc-422a-93cb-751d0241dd5f tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1319 microversion: 2.1 time: 0.151756 Sep 22 22:14:09.220366 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 254/472] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:09 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:09.485972 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-13db7a29-039a-40c7-8ab2-520d3a2df9a9 req-3ae41813-62db-4390-86e4-81bff551f390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049be337-3d21-42c8-97e2-46af2bdf2358", "name": "network-vif-plugged", "status": "completed", "tag": "f721a259-ddab-4029-9561-ccfde8c41208"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:14:09.496466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-13db7a29-039a-40c7-8ab2-520d3a2df9a9 req-3ae41813-62db-4390-86e4-81bff551f390 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:09.496977 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-13db7a29-039a-40c7-8ab2-520d3a2df9a9 req-3ae41813-62db-4390-86e4-81bff551f390 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:09.497424 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-13db7a29-039a-40c7-8ab2-520d3a2df9a9 req-3ae41813-62db-4390-86e4-81bff551f390 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:09.511037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-13db7a29-039a-40c7-8ab2-520d3a2df9a9 req-3ae41813-62db-4390-86e4-81bff551f390 service nova] Creating event network-vif-plugged:f721a259-ddab-4029-9561-ccfde8c41208 for instance 049be337-3d21-42c8-97e2-46af2bdf2358 on hv-cinder-84914 Sep 22 22:14:09.516664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-13db7a29-039a-40c7-8ab2-520d3a2df9a9 req-3ae41813-62db-4390-86e4-81bff551f390 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034489 Sep 22 22:14:09.517277 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 219/473] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:14:10.242876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:10.243486 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:10.245458 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:10.246108 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:10.252710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:10.253292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:10.253729 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:10.254422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:10.254869 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:10.255290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:10.313983 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:10.318755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-517548380", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:14:10.370240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] validate_networks() for None {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:14:10.412940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:10.420450 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-49c782ca-2770-4ea7-b6a3-5f9cb4225aa6 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1319 microversion: 2.1 time: 0.181384 Sep 22 22:14:10.421683 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 255/474] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:10 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:14:10.649727 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:14:10.650190 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:14:10.650609 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:14:10.651012 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:14:10.651419 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:14:10.660783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:10.661313 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:10.661748 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:10.662474 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:10.662925 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:10.663345 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:10.680104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Getting quotas for project 322c7c4ad81c41dfb148ae965fc964dc. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:14:10.684069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Getting quotas for user ce2f4de513274a00bd9a8783a7ff358a and project 322c7c4ad81c41dfb148ae965fc964dc. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:14:10.695358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:14:10.697776 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:14:10.743346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-07ef537a-c8e1-44aa-a540-04ade13771d7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.430222 Sep 22 22:14:10.743998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 220/475] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:14:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 22:14:10.761373 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b08cbd08-4ee7-4d56-8cce-02b8f8fb58ae tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:10.762161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b08cbd08-4ee7-4d56-8cce-02b8f8fb58ae tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:10.815026 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b08cbd08-4ee7-4d56-8cce-02b8f8fb58ae tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:10.823102 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b08cbd08-4ee7-4d56-8cce-02b8f8fb58ae tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1214 microversion: 2.1 time: 0.066785 Sep 22 22:14:10.825063 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 256/476] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:10 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:11.443901 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:11.444441 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:11.451370 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:11.451857 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:11.452500 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:11.453340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:11.453831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:11.454262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:11.582978 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:11.590575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5b861a07-7f14-4678-b74d-fa63dd1699e8 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1319 microversion: 2.1 time: 0.150681 Sep 22 22:14:11.591132 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 221/477] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:11 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:11.847789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:11.848401 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:11.854369 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:11.854851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:11.855289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:11.855972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:11.856424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:11.856846 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:11.917446 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:11.925547 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0f055c54-cb74-4c7f-b6ca-516406e843c9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1218 microversion: 2.1 time: 0.082611 Sep 22 22:14:11.926117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 257/478] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:11 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:12.613263 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:12.613826 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:12.620091 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:12.620573 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:12.621007 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:12.621780 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:12.622261 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:12.622681 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:12.749686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:12.757278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9ce22def-5005-429b-9035-60167c03f27b tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1507 microversion: 2.1 time: 0.148048 Sep 22 22:14:12.757842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 222/479] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:12 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:12.779447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-43b48600-238b-4c94-ba93-f3a0f2973099 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01af56f7-b4ea-44eb-8fe4-e82d6e17c546", "device": "/dev/sdb"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:14:12.782448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-43b48600-238b-4c94-ba93-f3a0f2973099 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:12.788514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43b48600-238b-4c94-ba93-f3a0f2973099 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:12.789146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43b48600-238b-4c94-ba93-f3a0f2973099 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:12.789450 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43b48600-238b-4c94-ba93-f3a0f2973099 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:12.790142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43b48600-238b-4c94-ba93-f3a0f2973099 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:12.790596 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43b48600-238b-4c94-ba93-f3a0f2973099 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:12.791017 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-43b48600-238b-4c94-ba93-f3a0f2973099 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:12.947761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:12.948286 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:12.954661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:12.955145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:12.955579 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:12.956261 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:12.956714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:12.957164 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:13.019471 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:13.027019 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c3469902-af88-48f5-86e8-423b44b76583 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1266 microversion: 2.1 time: 0.083130 Sep 22 22:14:13.027586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 223/480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:12 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:14:13.694864 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-43b48600-238b-4c94-ba93-f3a0f2973099 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "POST /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918923 Sep 22 22:14:13.696134 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 258/481] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:14:12 2022] POST /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:14:14.050775 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:14.052190 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:14.058743 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:14.060072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:14.060788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:14.062398 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:14.063140 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:14.063688 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:14.153524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:14.161031 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2fd0605d-bb52-46e6-a800-08fe51708f70 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1272 microversion: 2.1 time: 0.114496 Sep 22 22:14:14.161630 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 224/482] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:14 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:14:15.153636 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-222b9d5b-6ad8-4cbb-a4ed-a53cf551ad7d req-163b1070-6fb4-49b5-9af3-f859bbe40100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b5924eb-9d04-403e-a6d8-be2088f85438", "tag": "d2676da8-924b-45bb-b988-80844727c802"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:14:15.163186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-222b9d5b-6ad8-4cbb-a4ed-a53cf551ad7d req-163b1070-6fb4-49b5-9af3-f859bbe40100 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:15.163664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-222b9d5b-6ad8-4cbb-a4ed-a53cf551ad7d req-163b1070-6fb4-49b5-9af3-f859bbe40100 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:15.164077 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-222b9d5b-6ad8-4cbb-a4ed-a53cf551ad7d req-163b1070-6fb4-49b5-9af3-f859bbe40100 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:15.177556 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-222b9d5b-6ad8-4cbb-a4ed-a53cf551ad7d req-163b1070-6fb4-49b5-9af3-f859bbe40100 service nova] Creating event network-changed:d2676da8-924b-45bb-b988-80844727c802 for instance 6b5924eb-9d04-403e-a6d8-be2088f85438 on hv-cinder-84914 Sep 22 22:14:15.182549 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-222b9d5b-6ad8-4cbb-a4ed-a53cf551ad7d req-163b1070-6fb4-49b5-9af3-f859bbe40100 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033764 Sep 22 22:14:15.183918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 259/483] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:14:15.184196 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:15.184808 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:15.192417 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:15.193096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:15.193702 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:15.194401 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:15.194854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:15.195291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:15.334141 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:15.341656 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-32052e5f-ea73-4505-9ebe-bd4135fbb39b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.161651 Sep 22 22:14:15.342217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 225/484] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:15 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:16.365518 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:16.366206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:16.372989 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:16.374657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:16.375105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:16.375788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:16.376239 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:16.376656 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:16.506915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:16.514508 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7e28fc8d-b2fa-4b3a-9073-90f2560af7db tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.153117 Sep 22 22:14:16.515223 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 260/485] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:16 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:17.537510 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:17.538149 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:17.544641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:17.545248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:17.545934 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:17.546620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:17.547093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:17.547764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:17.678177 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:17.685685 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5615d11f-59c6-4053-9495-3dee2fa4ec11 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.152013 Sep 22 22:14:17.686733 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 226/486] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:17 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:18.708801 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:18.709437 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:18.715770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:18.716257 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:18.716693 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:18.718031 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:18.718485 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:18.718912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:18.857161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:18.864918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5a1511f3-c7b0-44a5-a432-dc33044c2c69 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.160001 Sep 22 22:14:18.865516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 261/487] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:18 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:19.886874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:19.887480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:19.894583 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:19.895063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:19.895495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:19.896178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:19.896628 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:19.897051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:20.025764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:20.034262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bd061f34-25b2-4a4d-9394-94cd0729f075 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.151238 Sep 22 22:14:20.035489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 227/488] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:19 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:21.056947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:21.058028 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:21.060055 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:21.066143 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:21.066642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:21.067085 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:21.067823 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:21.068283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:21.068713 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:21.202261 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:21.209866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a83cb03b-89eb-417d-bc40-a184aa269112 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.156845 Sep 22 22:14:21.210435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 262/489] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:21 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:22.233313 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:22.233910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:22.235757 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:22.236392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:22.242565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:22.243039 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:22.243466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:22.244143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:22.244584 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:22.245008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:22.374255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:22.381858 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-97f9d7fc-795a-4ac8-b793-c200a339eb5d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.153000 Sep 22 22:14:22.382416 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 228/490] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:22 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:23.405959 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:23.406671 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:23.413022 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:23.413520 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:23.413950 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:23.414643 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:23.415089 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:23.415507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:23.536716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-2a14544d-7476-4a00-b869-f74ddba1992e req-c33c8792-04b7-4b91-8cd4-17d676ce9797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5924eb-9d04-403e-a6d8-be2088f85438", "name": "network-vif-plugged", "status": "completed", "tag": "d2676da8-924b-45bb-b988-80844727c802"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:14:23.548828 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:23.549561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2a14544d-7476-4a00-b869-f74ddba1992e req-c33c8792-04b7-4b91-8cd4-17d676ce9797 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:23.550043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2a14544d-7476-4a00-b869-f74ddba1992e req-c33c8792-04b7-4b91-8cd4-17d676ce9797 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:23.550462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2a14544d-7476-4a00-b869-f74ddba1992e req-c33c8792-04b7-4b91-8cd4-17d676ce9797 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:23.556882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b12d54a6-fd86-401e-8f01-ec86ac69b87c tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.154886 Sep 22 22:14:23.557702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 263/491] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:23 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:23.562120 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-2a14544d-7476-4a00-b869-f74ddba1992e req-c33c8792-04b7-4b91-8cd4-17d676ce9797 service nova] Creating event network-vif-plugged:d2676da8-924b-45bb-b988-80844727c802 for instance 6b5924eb-9d04-403e-a6d8-be2088f85438 on hv-cinder-84914 Sep 22 22:14:23.567022 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-2a14544d-7476-4a00-b869-f74ddba1992e req-c33c8792-04b7-4b91-8cd4-17d676ce9797 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034885 Sep 22 22:14:23.567597 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 229/492] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:14:24.579516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:24.580051 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:24.587169 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:24.587650 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:24.588148 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:24.588843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:24.589324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:24.589748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:24.717439 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:24.725059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e15e0909-d942-4cdf-84db-42379e95fc5b tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.149571 Sep 22 22:14:24.725649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 264/493] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:24 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:25.749457 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:25.750165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:25.756246 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:25.756733 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:25.757201 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:25.757894 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:25.758353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:25.758782 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:25.892009 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:25.899640 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3db7fa07-9b08-4f2f-9b9c-e4054d49c6c1 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.155151 Sep 22 22:14:25.900207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 230/494] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:25 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:26.923306 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:26.923951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:26.930466 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:26.930951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:26.931387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:26.932080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:26.932538 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:26.932965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:27.065214 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:27.072802 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-35263b72-da70-4c0d-b152-7f5c78af537f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.154581 Sep 22 22:14:27.073390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 265/495] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:26 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:28.094788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:28.095391 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:28.101801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:28.102280 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:28.102709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:28.103385 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:28.103835 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:28.104253 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:28.236838 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:28.244356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fed18f17-b0b7-4f12-bc00-ccc9970658d9 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.153549 Sep 22 22:14:28.244912 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 231/496] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:28 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:29.267678 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:29.268282 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:29.270592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:29.276689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:29.277195 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:29.277635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:29.278324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:29.278783 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:29.279206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:29.282289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:29.409293 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:29.416812 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0fe0c871-7a51-490e-bb76-05e9a8f57dd5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.153012 Sep 22 22:14:29.417410 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 266/497] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:29 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:30.441726 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:30.442344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:30.444724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:30.450768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:30.451597 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:30.452042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:30.452756 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:30.453223 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:30.453651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:30.458404 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=91 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:14:30.582189 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:30.589694 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0eb820d8-9a57-473b-b1ca-5b53ed224753 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.151801 Sep 22 22:14:30.590251 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 232/498] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:30 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:31.613765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:31.614369 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:31.620844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:31.621366 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:31.621804 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:31.623126 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:31.623585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:31.624009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:31.750558 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:31.758053 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-597c0549-c378-42d9-907a-bf1ed85ccef0 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.148156 Sep 22 22:14:31.758619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 267/499] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:31 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:32.780459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:32.781070 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:32.787560 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:32.788043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:32.788473 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:32.789179 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:32.789636 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:32.790060 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:33.134788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:33.142421 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1e45fc30-b084-4b49-b7a4-fedd8403d50f tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.365884 Sep 22 22:14:33.142983 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 233/500] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:32 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:34.164653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:34.165300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:34.172507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:34.172988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:34.173460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:34.174146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:34.174599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:34.175020 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:34.306632 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:34.314954 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6a59ce69-3407-470d-9600-e0263742a905 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.154180 Sep 22 22:14:34.315526 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 268/501] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:34 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:35.337848 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:35.338455 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:35.344862 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:35.345373 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:35.345830 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:35.346494 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:35.346945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:35.347367 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:35.475477 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:35.483709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a73dbba9-d578-48a4-a2b4-1a409f9f2fcc tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.149713 Sep 22 22:14:35.484271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 234/502] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:35 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:36.506630 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:36.507238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:36.514250 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:36.514731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:36.515163 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:36.515849 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:36.516303 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:36.516725 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:36.722353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:36.729997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8158d4ca-13fe-4151-9b13-618b69ac286d tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1314 microversion: 2.1 time: 0.227185 Sep 22 22:14:36.730550 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 269/503] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:36 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:37.753909 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:37.754519 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:37.761616 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:37.762096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:37.762555 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:37.763528 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:37.763990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:37.764440 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:37.891392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:37.899078 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-49d0d5d8-0605-4a34-8d0a-57e7009a737e tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1463 microversion: 2.1 time: 0.149058 Sep 22 22:14:37.899648 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 235/504] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:37 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:14:37.946145 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:37.946627 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:37.953208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:37.953684 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:37.954110 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:37.954784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:37.955230 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:37.955645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:37.980170 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:14:38.052244 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2d850ba4-a63b-4298-a049-fa4b6e421ba7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 204 len: 0 microversion: 2.1 time: 0.109600 Sep 22 22:14:38.052934 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 270/505] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:14:37 2022] DELETE /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:14:38.064037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:38.064642 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:38.070669 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:38.071145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:38.071572 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:38.072251 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:38.072709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:38.073154 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:38.199765 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:38.207614 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d057907a-1ee6-4027-a48b-434904c4bff5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1469 microversion: 2.1 time: 0.148133 Sep 22 22:14:38.208181 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 236/506] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:38 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:39.231934 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:39.232616 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:39.239019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:39.239500 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:39.239933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:39.240615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:39.241068 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:39.241639 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:39.374790 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:39.382474 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8c890fa1-c1d8-4c2e-a871-4f700c68b205 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1469 microversion: 2.1 time: 0.155377 Sep 22 22:14:39.383034 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 271/507] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:39 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:40.405527 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:40.406137 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:40.412475 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:40.412947 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:40.413405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:40.414091 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:40.414555 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:40.414955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:40.542087 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:40.550433 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1c742ffa-6672-4631-a270-0f98a636bf88 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1469 microversion: 2.1 time: 0.148850 Sep 22 22:14:40.551003 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 237/508] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:40 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:41.574142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:41.574676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:41.581760 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:41.582240 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:41.582667 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:41.583344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:41.583791 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:41.584209 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:41.715764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:41.724147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-68ff039e-ee05-471a-baa4-9b4aa46ede41 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1469 microversion: 2.1 time: 0.153937 Sep 22 22:14:41.724703 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 272/509] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:41 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:42.746379 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:42.747118 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:42.753412 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:42.753891 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:42.754323 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:42.755006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:42.755462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:42.755885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:42.888408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:42.896501 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-70c9fac9-a920-43c5-8ff2-c962d8dd2be5 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1469 microversion: 2.1 time: 0.154009 Sep 22 22:14:42.897077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 238/510] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:42 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:43.919233 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:43.919862 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:43.926127 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:43.926610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:43.927034 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:43.927716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:43.928165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:43.928576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:44.149483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:44.157622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-67b62399-0c27-4498-a3c0-19eed1ffb9e7 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1469 microversion: 2.1 time: 0.242445 Sep 22 22:14:44.158442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 273/511] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:43 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:44.464586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-a5259ce4-db2a-49f1-8cb9-41635972052d req-23a238a1-e334-4449-9f69-ed5e813844f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5924eb-9d04-403e-a6d8-be2088f85438", "name": "network-vif-deleted", "tag": "d2676da8-924b-45bb-b988-80844727c802"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:14:44.479301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a5259ce4-db2a-49f1-8cb9-41635972052d req-23a238a1-e334-4449-9f69-ed5e813844f5 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:44.479790 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a5259ce4-db2a-49f1-8cb9-41635972052d req-23a238a1-e334-4449-9f69-ed5e813844f5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:44.480219 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a5259ce4-db2a-49f1-8cb9-41635972052d req-23a238a1-e334-4449-9f69-ed5e813844f5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:44.491804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-a5259ce4-db2a-49f1-8cb9-41635972052d req-23a238a1-e334-4449-9f69-ed5e813844f5 service nova] Creating event network-vif-deleted:d2676da8-924b-45bb-b988-80844727c802 for instance 6b5924eb-9d04-403e-a6d8-be2088f85438 on hv-cinder-84914 Sep 22 22:14:44.502422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-a5259ce4-db2a-49f1-8cb9-41635972052d req-23a238a1-e334-4449-9f69-ed5e813844f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041315 Sep 22 22:14:44.506127 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 239/512] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:14:45.182153 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:45.182764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:45.189635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:45.190128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:45.190583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:45.191270 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:45.191732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:45.192161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:45.223127 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:45.223528 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:45.223966 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:45.224412 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lazy-loading 'fault' on Instance uuid 6b5924eb-9d04-403e-a6d8-be2088f85438 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:14:45.273581 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2f4de513274a00bd9a8783a7ff358a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322c7c4ad81c41dfb148ae965fc964dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:45.282943 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-aa336bd1-fd1c-4713-b899-08b999a85373 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 200 len: 1304 microversion: 2.1 time: 0.104851 Sep 22 22:14:45.283511 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 274/513] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:45 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:45.720744 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:45.721373 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:45.727535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:45.728015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:45.728452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:45.729170 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:45.729633 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:45.730056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:45.810974 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lazy-loading 'services' on Instance uuid 049be337-3d21-42c8-97e2-46af2bdf2358 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:14:45.882796 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-afd70bda-d657-4e21-b86a-1142c3d79a96 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "DELETE /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358/os-volume_attachments/01af56f7-b4ea-44eb-8fe4-e82d6e17c546" status: 202 len: 0 microversion: 2.1 time: 0.167303 Sep 22 22:14:45.883477 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 240/514] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:14:45 2022] DELETE /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358/os-volume_attachments/01af56f7-b4ea-44eb-8fe4-e82d6e17c546 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:14:46.307117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:46.307727 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] [instance: 6b5924eb-9d04-403e-a6d8-be2088f85438] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:46.313981 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:46.314462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:46.314897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:46.315575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:46.316025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:46.316443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:46.330034 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] HTTP exception thrown: Instance 6b5924eb-9d04-403e-a6d8-be2088f85438 could not be found. Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Request method failure captured: Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 HTTP/1.1 Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN4vsKgtNfoDvHQkjS8Dj-z7Myf4NCroi6aZca7ulpKHDm2gkFg2xtFX-NCBQmn8smxyfp_SukHukqVRy2FctCZaLcn_td9lpGX70pbIuLGNz18i8TkAAQt_NXDMTlSZ9Yily0b_PmxJC4U5ff52ACPgmIVPETwks1n4Gdy1oFKfBdw Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 322c7c4ad81c41dfb148ae965fc964dc Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesNegativeTest-2129045178 Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:14:46.331663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/322c7c4ad81c41dfb148ae965fc964dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/322c7c4ad81c41dfb148ae965fc964dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/322c7c4ad81c41dfb148ae965fc964dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_322c7c4ad81c41dfb148ae965fc964dc", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesNegativeTest-2129045178 Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 322c7c4ad81c41dfb148ae965fc964dc Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesNegativeTest-2129045178 Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesNegativeTest-2129045178-project Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: ce2f4de513274a00bd9a8783a7ff358a Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesNegativeTest-2129045178-project Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 6b5924eb-9d04-403e-a6d8-be2088f85438 could not be found. Sep 22 22:14:46.333315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '6b5924eb-9d04-403e-a6d8-be2088f85438'} Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b5924eb-9d04-403e-a6d8-be2088f85438 could not be found. Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:14:46.334246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b5924eb-9d04-403e-a6d8-be2088f85438 could not be found. Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b5924eb-9d04-403e-a6d8-be2088f85438 could not be found. Sep 22 22:14:46.335720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:46.337038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] Returning 404 to user: Instance 6b5924eb-9d04-403e-a6d8-be2088f85438 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:14:46.337038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c8af0571-1f49-4a7f-8ee2-eebf8954c040 tempest-VolumesNegativeTest-2129045178 tempest-VolumesNegativeTest-2129045178-project] 10.222.0.25 "GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438" status: 404 len: 111 microversion: 2.1 time: 0.029788 Sep 22 22:14:46.337038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 275/515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:46 2022] GET /compute/v2.1/servers/6b5924eb-9d04-403e-a6d8-be2088f85438 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:14:47.020960 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:47.022425 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:47.029701 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:47.030221 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:47.030616 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:47.031309 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:47.031752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:47.032472 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:47.062608 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:14:47.152259 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bd1f2c25-3af9-4ff6-a5cc-9775974e9995 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "DELETE /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 204 len: 0 microversion: 2.1 time: 0.136431 Sep 22 22:14:47.154139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 241/516] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:14:47 2022] DELETE /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:14:47.162090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:47.162883 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:47.169643 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:47.170039 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:47.170469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:47.171468 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:47.171925 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:47.172347 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:47.311315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:47.319685 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-47130cb1-c8ad-4dd6-ae7d-36604f8104e0 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1513 microversion: 2.1 time: 0.161906 Sep 22 22:14:47.320247 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 276/517] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:47 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:48.342798 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:48.343488 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:48.350385 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:48.350946 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:48.351379 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:48.352069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:48.352518 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:48.352936 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:48.486187 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:48.493865 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-02e9048a-f2f9-44f9-862f-5c529aa8b1aa tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1513 microversion: 2.1 time: 0.155169 Sep 22 22:14:48.494497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 242/518] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:48 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:49.517653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:49.518255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:49.524767 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:49.525286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:49.525719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:49.526418 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:49.526859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:49.527279 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:49.778225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a3c0cff4787a90603f3afb2e883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58361c0e40c48f4966aee3515859326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:14:49.786048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-45677983-1e50-4b61-a4df-b498ece843ea tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 200 len: 1513 microversion: 2.1 time: 0.272187 Sep 22 22:14:49.786612 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 277/519] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:49 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:14:50.024906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-36ad6d6a-3058-4a2d-accb-b6b16af6f887 req-5f7ad67c-c166-444f-aa46-a81a7e71340d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049be337-3d21-42c8-97e2-46af2bdf2358", "name": "network-vif-deleted", "tag": "f721a259-ddab-4029-9561-ccfde8c41208"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:14:50.036875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-36ad6d6a-3058-4a2d-accb-b6b16af6f887 req-5f7ad67c-c166-444f-aa46-a81a7e71340d service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:50.037388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-36ad6d6a-3058-4a2d-accb-b6b16af6f887 req-5f7ad67c-c166-444f-aa46-a81a7e71340d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:50.037868 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-36ad6d6a-3058-4a2d-accb-b6b16af6f887 req-5f7ad67c-c166-444f-aa46-a81a7e71340d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:50.052956 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-36ad6d6a-3058-4a2d-accb-b6b16af6f887 req-5f7ad67c-c166-444f-aa46-a81a7e71340d service nova] Creating event network-vif-deleted:f721a259-ddab-4029-9561-ccfde8c41208 for instance 049be337-3d21-42c8-97e2-46af2bdf2358 on hv-cinder-84914 Sep 22 22:14:50.061181 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-36ad6d6a-3058-4a2d-accb-b6b16af6f887 req-5f7ad67c-c166-444f-aa46-a81a7e71340d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038964 Sep 22 22:14:50.063424 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 243/520] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:14:50.811338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:50.811948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] [instance: 049be337-3d21-42c8-97e2-46af2bdf2358] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:50.819390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:50.819898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:50.820324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:50.821020 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:50.821502 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:50.821928 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:50.839716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] HTTP exception thrown: Instance 049be337-3d21-42c8-97e2-46af2bdf2358 could not be found. Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Request method failure captured: Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 HTTP/1.1 Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN10vEiJPb6KxQPFpPw2fehVQdQ2Ql6JDuhgPB2EA6U-4DgMOEqKKnbcDM3fKxxn_vUiOv6HSCu9HCixyL48iVUt8CJlPyooF1JSO76j4PZXXf5jkvAvWzDl1ZwZgBh8hXthYUUD1jVtrYBTebBrqbFuBBFUbZ2tXFdD_sOQpeM3YAM Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: d58361c0e40c48f4966aee3515859326 Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1070519364 Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:14:50.841287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d58361c0e40c48f4966aee3515859326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d58361c0e40c48f4966aee3515859326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d58361c0e40c48f4966aee3515859326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d58361c0e40c48f4966aee3515859326", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesSnapshotTestJSON-1070519364 Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: d58361c0e40c48f4966aee3515859326 Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1070519364 Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesSnapshotTestJSON-1070519364-project Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: cd913a3c0cff4787a90603f3afb2e883 Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesSnapshotTestJSON-1070519364-project Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 049be337-3d21-42c8-97e2-46af2bdf2358 could not be found. Sep 22 22:14:50.842839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '049be337-3d21-42c8-97e2-46af2bdf2358'} Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049be337-3d21-42c8-97e2-46af2bdf2358 could not be found. Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:14:50.843657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049be337-3d21-42c8-97e2-46af2bdf2358 could not be found. Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049be337-3d21-42c8-97e2-46af2bdf2358 could not be found. Sep 22 22:14:50.845030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:14:50.846168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] Returning 404 to user: Instance 049be337-3d21-42c8-97e2-46af2bdf2358 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:14:50.846168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0d85359f-b685-45de-826a-7d7b91ca5965 tempest-VolumesSnapshotTestJSON-1070519364 tempest-VolumesSnapshotTestJSON-1070519364-project] 10.222.0.25 "GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358" status: 404 len: 111 microversion: 2.1 time: 0.036128 Sep 22 22:14:50.846168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 278/521] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:14:50 2022] GET /compute/v2.1/servers/049be337-3d21-42c8-97e2-46af2bdf2358 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:14:59.100169 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1aa544f0-f1fd-4d96-a51a-24caa819c318 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:14:59.101387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1aa544f0-f1fd-4d96-a51a-24caa819c318 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:14:59.117082 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa544f0-f1fd-4d96-a51a-24caa819c318 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:59.117861 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa544f0-f1fd-4d96-a51a-24caa819c318 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:59.118488 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa544f0-f1fd-4d96-a51a-24caa819c318 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:59.119392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa544f0-f1fd-4d96-a51a-24caa819c318 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:14:59.120013 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa544f0-f1fd-4d96-a51a-24caa819c318 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:14:59.121153 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa544f0-f1fd-4d96-a51a-24caa819c318 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:14:59.174466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1aa544f0-f1fd-4d96-a51a-24caa819c318 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/ips" status: 200 len: 151 microversion: 2.1 time: 0.078163 Sep 22 22:14:59.175733 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 244/522] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:14:59 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/ips => generated 151 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:00.770136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fe2a94d3-2071-42b9-a305-53bfb969b857 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49ad5890-b87e-4061-af3b-05c4d050ea04"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:00.772667 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fe2a94d3-2071-42b9-a305-53bfb969b857 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:00.787448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:00.790090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe2a94d3-2071-42b9-a305-53bfb969b857 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:00.790805 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe2a94d3-2071-42b9-a305-53bfb969b857 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:00.791430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe2a94d3-2071-42b9-a305-53bfb969b857 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:00.793079 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe2a94d3-2071-42b9-a305-53bfb969b857 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:00.794269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe2a94d3-2071-42b9-a305-53bfb969b857 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:00.794948 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe2a94d3-2071-42b9-a305-53bfb969b857 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:00.807113 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:01.265509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fe2a94d3-2071-42b9-a305-53bfb969b857 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492553 Sep 22 22:15:01.265805 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd296560-14ce-415d-8e7c-5058fe266253 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Action: 'create', calling method: .version_select at 0x7f405cbe8a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1122905243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeG5OV5hl1mJHPzbi2eZPob94gItldqJYQ98NzSDupDmLUiCp3XM1Gq61bWx9Pxuh/WJifUoEOQX83FkfuKTdpJf312KCPDOd5IeO6+LEji0dBIr3lV5LLAFhchcRnJFg=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:01.271807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:01.274085 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 279/523] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:15:00 2022] POST /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:01.289422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-dd296560-14ce-415d-8e7c-5058fe266253 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Getting quotas for project e9c311fa04f241249d428df8e88539f4. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:15:01.294417 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-dd296560-14ce-415d-8e7c-5058fe266253 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Getting quotas for user cc89baeb82444da78312c4b0b3fb0c41 and project e9c311fa04f241249d428df8e88539f4. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:15:01.318629 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dd296560-14ce-415d-8e7c-5058fe266253 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.412292 Sep 22 22:15:01.320413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 245/524] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:15:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:15:09.922408 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-156dc4b6-a59e-4350-8cb9-421bf1fffdbb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: .version_select at 0x7f405cc26040>, body: {"keypair": {"name": "tempest-keypair-1410324415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsKS4kFWMe0ui7yCwzSeJ0iUokATMZfUVnh56+7q6MCysOXhuixPerKaO/Akm4iQM3f/+NGi2oKHImDDt/2wqvltUdnbgIM/98o9NRb70rFgvRjDguY5yZahFXvE8/InQ=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:09.937750 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-156dc4b6-a59e-4350-8cb9-421bf1fffdbb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for project 226257b343d24054bc2178b47a9a5a4f. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:15:09.941886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-156dc4b6-a59e-4350-8cb9-421bf1fffdbb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for user bcb617f1f41c467fba9717f7f825ac80 and project 226257b343d24054bc2178b47a9a5a4f. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:15:09.969435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-156dc4b6-a59e-4350-8cb9-421bf1fffdbb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051897 Sep 22 22:15:09.970029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 280/525] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:15:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:11.310242 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-660286764", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76b70dbd-430e-4822-82a3-49c7f238d2e2"}], "security_groups": [{"name": "tempest-securitygroup--139229468"}], "key_name": "tempest-keypair-1410324415", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:11.319351 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:11.320000 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=4 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:11.320725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:11.421469 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] validate_networks() for [('76b70dbd-430e-4822-82a3-49c7f238d2e2', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:15:11.805033 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:15:11.805530 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:15:11.806101 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:15:11.806509 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:15:11.807550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:15:11.816339 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:11.816813 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:11.817276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:11.818040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:11.818494 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:11.818909 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:11.838231 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for project 226257b343d24054bc2178b47a9a5a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:15:11.842069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for user bcb617f1f41c467fba9717f7f825ac80 and project 226257b343d24054bc2178b47a9a5a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:15:11.852814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:15:11.855139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:15:11.904046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4ec63bd2-edb6-4d97-9238-e89d1050b5aa tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.598850 Sep 22 22:15:11.904704 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 246/526] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:15:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:15:11.915992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-237d3b5b-3188-457e-947b-4d5d99ce4ee7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:11.917491 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-237d3b5b-3188-457e-947b-4d5d99ce4ee7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:11.920312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:12.090921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-237d3b5b-3188-457e-947b-4d5d99ce4ee7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:12.098888 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-237d3b5b-3188-457e-947b-4d5d99ce4ee7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1241 microversion: 2.1 time: 0.186541 Sep 22 22:15:12.109884 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 281/527] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:11 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:13.124011 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:13.124621 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:13.136927 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:13.137454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:13.137889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:13.138609 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:13.139062 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:13.139484 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:13.303198 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:13.312240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5f52b6a4-8ce5-41d1-8a8c-f9b47aad378a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1293 microversion: 2.1 time: 0.192645 Sep 22 22:15:13.313095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 247/528] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:13 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1293 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:14.337832 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:14.338788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:14.345743 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:14.346268 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:14.346813 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:14.347615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:14.348175 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:14.348697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:14.592939 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:14.601073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cf9bc421-5bfa-4664-9be4-e5814574e3ba tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.266847 Sep 22 22:15:14.602167 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 282/529] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:14 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:15.008963 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-f902313b-ca1c-4272-bffa-e8403ac23818 req-7feaabdd-9cb4-4517-9782-118adcc7b838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e7432c-e9dc-49c3-a476-991a48adde7c", "tag": "c3df795b-10a6-4413-9642-8213c6eae0f4"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:15.019741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f902313b-ca1c-4272-bffa-e8403ac23818 req-7feaabdd-9cb4-4517-9782-118adcc7b838 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:15.020227 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f902313b-ca1c-4272-bffa-e8403ac23818 req-7feaabdd-9cb4-4517-9782-118adcc7b838 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:15.020698 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f902313b-ca1c-4272-bffa-e8403ac23818 req-7feaabdd-9cb4-4517-9782-118adcc7b838 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:15.031882 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-f902313b-ca1c-4272-bffa-e8403ac23818 req-7feaabdd-9cb4-4517-9782-118adcc7b838 service nova] Creating event network-changed:c3df795b-10a6-4413-9642-8213c6eae0f4 for instance 60e7432c-e9dc-49c3-a476-991a48adde7c on hv-cinder-84914 Sep 22 22:15:15.037508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-f902313b-ca1c-4272-bffa-e8403ac23818 req-7feaabdd-9cb4-4517-9782-118adcc7b838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032640 Sep 22 22:15:15.038216 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 248/530] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:15.628343 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:15.628972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:15.635692 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:15.636165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:15.636595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:15.637376 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:15.637827 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:15.638243 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:15.777633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:15.785850 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1a4eb22a-79aa-45e3-84b8-a5321355b141 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.161292 Sep 22 22:15:15.786410 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 283/531] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:15 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:16.810262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:16.810862 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:16.817258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:16.817753 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:16.818187 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:16.818890 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:16.819341 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:16.819762 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:16.958770 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:16.966938 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ad709d46-9b66-4d1f-bf9f-c0b6323274b4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.161806 Sep 22 22:15:16.967514 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 249/532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:16 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:17.989695 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:17.990317 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:17.997764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:17.998254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:17.998694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:17.999433 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:17.999970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:18.000321 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:18.160660 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:18.170209 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-54434bf1-c786-451f-8192-d6af966c18e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.184181 Sep 22 22:15:18.170895 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 284/533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:17 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:19.192574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:19.193793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:19.208104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:19.208610 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:19.209216 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:19.210090 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:19.210527 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:19.212477 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:19.439006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:19.447141 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9bdc2821-db22-4cc3-83e8-b881e0be920f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.258257 Sep 22 22:15:19.463489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 250/534] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:19 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:20.635346 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:20.636006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:20.641961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:20.642444 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:20.642886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:20.643568 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:20.644025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:20.644449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:20.781254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:20.788891 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eed9d3eb-d29a-4313-ab51-9321eef88ee6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.320673 Sep 22 22:15:20.801581 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 285/535] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:20 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:21.813505 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:21.814112 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:21.820668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:21.821180 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:21.821663 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:21.823131 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:21.823584 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:21.824010 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:21.826968 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:21.848392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:21.952827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:21.960452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-70a2236d-2493-4de5-9089-747f3aaebf55 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.150818 Sep 22 22:15:21.961018 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 251/536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:21 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:22.955894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-271a2d49-7831-4a51-98f2-dc14fff45413 req-cb94c38f-22ce-4997-a486-908d07e45e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e7432c-e9dc-49c3-a476-991a48adde7c", "name": "network-vif-plugged", "status": "completed", "tag": "c3df795b-10a6-4413-9642-8213c6eae0f4"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:22.961464 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:22.968199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-271a2d49-7831-4a51-98f2-dc14fff45413 req-cb94c38f-22ce-4997-a486-908d07e45e0f service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:22.968765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-271a2d49-7831-4a51-98f2-dc14fff45413 req-cb94c38f-22ce-4997-a486-908d07e45e0f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:22.969226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-271a2d49-7831-4a51-98f2-dc14fff45413 req-cb94c38f-22ce-4997-a486-908d07e45e0f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:22.981889 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-271a2d49-7831-4a51-98f2-dc14fff45413 req-cb94c38f-22ce-4997-a486-908d07e45e0f service nova] Creating event network-vif-plugged:c3df795b-10a6-4413-9642-8213c6eae0f4 for instance 60e7432c-e9dc-49c3-a476-991a48adde7c on hv-cinder-84914 Sep 22 22:15:22.983595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:22.984644 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:22.988209 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-271a2d49-7831-4a51-98f2-dc14fff45413 req-cb94c38f-22ce-4997-a486-908d07e45e0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035799 Sep 22 22:15:22.989378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 286/537] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:22.991784 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:22.992272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:22.992700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:22.993385 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:22.993987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:22.994414 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:23.121368 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:23.128893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9ace4ee8-4ec2-479e-bac5-8c9d69f8b4cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.149251 Sep 22 22:15:23.129496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 252/538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:22 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:15:24.153662 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:24.154347 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:24.160526 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:24.160998 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:24.161451 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:24.162127 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:24.162572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:24.162988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:24.293478 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:24.301155 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9c99e75a-ee39-44fe-bee6-1ebdc8788c54 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.152929 Sep 22 22:15:24.301714 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 287/539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:24 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:25.324387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:25.324961 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:25.331283 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:25.331757 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:25.332199 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:25.332864 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:25.333342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:25.333759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:25.459856 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:25.467788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-420d8a98-8d14-42a9-949b-4eb4b3a035c6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.147905 Sep 22 22:15:25.468352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 253/540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:25 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:26.490954 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:26.491478 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:26.498166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:26.498660 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:26.499078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:26.499760 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:26.500208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:26.500628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:26.632648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:26.641236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f73e6fb9-f596-45d1-9016-44d9fe1a38d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.154057 Sep 22 22:15:26.641814 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 288/541] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:26 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:27.665451 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:27.666673 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:27.673467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:27.673948 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:27.674381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:27.675067 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:27.675516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:27.675937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:27.808405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:27.815899 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9d66a261-1fe5-44aa-a16e-485b8131f597 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.154296 Sep 22 22:15:27.816459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 254/542] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:27 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:28.838712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:28.839350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:28.845709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:28.846272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:28.846694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:28.847470 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:28.847927 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:28.848361 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:28.981245 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:28.988712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-82951786-776a-4d09-ae47-7843795cda3c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.154098 Sep 22 22:15:28.989423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 289/543] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:28 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:30.011804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:30.012406 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:30.018758 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:30.019233 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:30.019688 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:30.020372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:30.020820 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:30.021265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:30.152510 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:30.160107 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9c92856a-f2b5-428e-8286-469e9d306876 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.152339 Sep 22 22:15:30.160671 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 255/544] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:30 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:31.184311 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:31.184846 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:31.187297 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:31.192658 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:31.193161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:31.193600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:31.194286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:31.194737 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:31.195164 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:31.327107 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:31.334763 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a5f40e6a-1b9f-4fe0-9438-0efbfeebf9d5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.155182 Sep 22 22:15:31.335340 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 290/545] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:31 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:32.357865 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:32.358580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:32.365076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:32.365586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:32.366020 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:32.366702 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:32.367154 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:32.367603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:32.496257 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:32.503843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-268ce56a-2f73-4917-9840-6a6b450f9cca tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.149852 Sep 22 22:15:32.504406 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 256/546] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:32 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:33.527637 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:33.528249 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:33.534666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:33.535145 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:33.535574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:33.536256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:33.536707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:33.537149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:33.666911 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:33.674619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6f7e4505-3ce5-4255-aa72-af19e9a7e76f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.151458 Sep 22 22:15:33.675177 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 291/547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:33 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:34.698996 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:34.699598 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:34.706094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:34.706575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:34.707001 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:34.707679 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:34.708129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:34.708609 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:34.835615 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:34.843848 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6c0be30e-0967-4a0a-be3b-404689d995c5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1366 microversion: 2.1 time: 0.148980 Sep 22 22:15:34.844424 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 257/548] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:34 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:35.867161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:35.867724 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:35.874696 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:35.875176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:35.875607 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:35.876294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:35.876750 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:35.877204 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:36.001392 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:36.009301 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-52322914-8b75-4e08-b7f0-30a6407e51a1 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1556 microversion: 2.1 time: 0.145794 Sep 22 22:15:36.009871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 292/549] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:35 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:36.039428 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-466a7ea4-cfb9-4523-a037-7691b133253f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:36.040659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-466a7ea4-cfb9-4523-a037-7691b133253f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:36.052426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-466a7ea4-cfb9-4523-a037-7691b133253f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:36.053167 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-466a7ea4-cfb9-4523-a037-7691b133253f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:36.053605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-466a7ea4-cfb9-4523-a037-7691b133253f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:36.054304 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-466a7ea4-cfb9-4523-a037-7691b133253f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:36.054752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-466a7ea4-cfb9-4523-a037-7691b133253f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:36.055215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-466a7ea4-cfb9-4523-a037-7691b133253f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:36.135499 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-466a7ea4-cfb9-4523-a037-7691b133253f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099900 Sep 22 22:15:36.136095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 258/550] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 22 22:15:36 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:37.059844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-ad96d9b2-472c-401e-93c9-52bb7e9831b0 req-7b5432d0-dc6d-479f-a57a-42ba4a1b686c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e7432c-e9dc-49c3-a476-991a48adde7c", "tag": "c3df795b-10a6-4413-9642-8213c6eae0f4"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:37.069980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-ad96d9b2-472c-401e-93c9-52bb7e9831b0 req-7b5432d0-dc6d-479f-a57a-42ba4a1b686c service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:37.070455 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-ad96d9b2-472c-401e-93c9-52bb7e9831b0 req-7b5432d0-dc6d-479f-a57a-42ba4a1b686c service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:37.071710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-ad96d9b2-472c-401e-93c9-52bb7e9831b0 req-7b5432d0-dc6d-479f-a57a-42ba4a1b686c service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:37.082648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-ad96d9b2-472c-401e-93c9-52bb7e9831b0 req-7b5432d0-dc6d-479f-a57a-42ba4a1b686c service nova] Creating event network-changed:c3df795b-10a6-4413-9642-8213c6eae0f4 for instance 60e7432c-e9dc-49c3-a476-991a48adde7c on hv-cinder-84914 Sep 22 22:15:37.087671 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-ad96d9b2-472c-401e-93c9-52bb7e9831b0 req-7b5432d0-dc6d-479f-a57a-42ba4a1b686c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032145 Sep 22 22:15:37.088242 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 293/551] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:43.142394 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1458906960", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1122905243", "security_groups": [{"name": "tempest-secgroup-smoke-67558175"}], "block_device_mapping_v2": [{"uuid": "f12dab85-c93e-412c-93c4-1d67f89da498", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c773c61e-e7b7-47c6-998a-83ddea69af57"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:43.153761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:43.260459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] validate_networks() for [('c773c61e-e7b7-47c6-998a-83ddea69af57', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:15:43.703760 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:15:43.704184 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:15:43.704652 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:15:43.705055 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:15:43.705483 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:15:43.714186 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:43.714605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:43.715034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:43.715755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:43.716202 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:43.716624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:43.723158 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=69 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:43.733946 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Getting quotas for project e9c311fa04f241249d428df8e88539f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:15:43.737847 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Getting quotas for user cc89baeb82444da78312c4b0b3fb0c41 and project e9c311fa04f241249d428df8e88539f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:15:43.795602 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:15:43.797904 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f12dab85-c93e-412c-93c4-1d67f89da498',volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:15:43.931237 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3ad0d93a-5c05-45c7-9f81-013d232563da tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.793431 Sep 22 22:15:43.931882 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 259/552] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:15:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:15:43.944436 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-839557d6-6fb7-48a7-a0a8-2c22d522b22a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:43.945160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-839557d6-6fb7-48a7-a0a8-2c22d522b22a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:44.001124 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-839557d6-6fb7-48a7-a0a8-2c22d522b22a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:44.007880 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-839557d6-6fb7-48a7-a0a8-2c22d522b22a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1095 microversion: 2.1 time: 0.068332 Sep 22 22:15:44.008445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 294/553] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:43 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:45.030860 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:45.031668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:45.037881 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:45.038367 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:45.038801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:45.039495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:45.040029 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:45.040454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:45.100978 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:45.108563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e7e1b9e9-9748-4f32-9fc0-3b77a2dd30ab tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1193 microversion: 2.1 time: 0.082069 Sep 22 22:15:45.109130 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 260/554] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:45 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:46.133219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:46.134513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:46.142233 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:46.142720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:46.143154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:46.143875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:46.144305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:46.144908 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:46.163226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=65 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:46.375284 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:46.383003 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-519cb012-212a-4365-9589-486c0773dd41 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1277 microversion: 2.1 time: 0.255234 Sep 22 22:15:46.384380 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 295/555] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:46 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:47.069390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-09e19281-1abe-4eb6-8ea9-f549302fe79e req-df928d81-7fde-4f51-addf-40b64d19447d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e642fd-e734-4624-b2be-6fd3141f7a8c", "tag": "bdfb86dd-821c-462a-a36c-ab4f3c618d51"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:47.079785 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-09e19281-1abe-4eb6-8ea9-f549302fe79e req-df928d81-7fde-4f51-addf-40b64d19447d service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:47.080544 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-09e19281-1abe-4eb6-8ea9-f549302fe79e req-df928d81-7fde-4f51-addf-40b64d19447d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:47.081188 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-09e19281-1abe-4eb6-8ea9-f549302fe79e req-df928d81-7fde-4f51-addf-40b64d19447d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:47.095383 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-09e19281-1abe-4eb6-8ea9-f549302fe79e req-df928d81-7fde-4f51-addf-40b64d19447d service nova] Creating event network-changed:bdfb86dd-821c-462a-a36c-ab4f3c618d51 for instance a9e642fd-e734-4624-b2be-6fd3141f7a8c on hv-cinder-84914 Sep 22 22:15:47.100288 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-09e19281-1abe-4eb6-8ea9-f549302fe79e req-df928d81-7fde-4f51-addf-40b64d19447d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183622 Sep 22 22:15:47.100887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 261/556] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:47.323076 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c9f89f7-8cf1-4f98-89bd-5964617b617b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:47.323738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7c9f89f7-8cf1-4f98-89bd-5964617b617b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:47.330210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c9f89f7-8cf1-4f98-89bd-5964617b617b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:47.330766 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c9f89f7-8cf1-4f98-89bd-5964617b617b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:47.331260 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c9f89f7-8cf1-4f98-89bd-5964617b617b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:47.332015 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c9f89f7-8cf1-4f98-89bd-5964617b617b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:47.332534 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c9f89f7-8cf1-4f98-89bd-5964617b617b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:47.333060 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c9f89f7-8cf1-4f98-89bd-5964617b617b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:47.357118 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7c9f89f7-8cf1-4f98-89bd-5964617b617b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/ips" status: 200 len: 146 microversion: 2.1 time: 0.038181 Sep 22 22:15:47.357694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 296/557] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:15:47 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:47.408051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:47.408828 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:47.416271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:47.416882 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:47.417436 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:47.418208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:47.418998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:47.419489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:47.586764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:47.595992 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-333e15b5-3384-400a-b1bd-6a102ee16f12 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.192884 Sep 22 22:15:47.596566 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 262/558] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:47 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:48.621639 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:48.623014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:48.632636 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:48.640373 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:48.640915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:48.641914 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:48.642383 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:48.643101 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:48.862073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:48.872304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4b5a7bf5-6007-4564-8e05-7a73a7b261a5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.256144 Sep 22 22:15:48.873203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 297/559] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:48 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:49.704295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-96ae4e6b-b2af-42fd-b0e1-51b042b98aa9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "018f6974-bf82-49a7-9599-0892c39fc97c"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:49.708013 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-96ae4e6b-b2af-42fd-b0e1-51b042b98aa9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:49.719761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96ae4e6b-b2af-42fd-b0e1-51b042b98aa9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:49.720584 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96ae4e6b-b2af-42fd-b0e1-51b042b98aa9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:49.721323 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96ae4e6b-b2af-42fd-b0e1-51b042b98aa9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:49.723157 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96ae4e6b-b2af-42fd-b0e1-51b042b98aa9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:49.723857 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96ae4e6b-b2af-42fd-b0e1-51b042b98aa9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:49.724523 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-96ae4e6b-b2af-42fd-b0e1-51b042b98aa9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:49.901068 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:49.901764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:49.909667 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:49.910233 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:49.910778 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:49.911787 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:49.912247 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:49.912672 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:50.048387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-96ae4e6b-b2af-42fd-b0e1-51b042b98aa9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349344 Sep 22 22:15:50.056594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 263/560] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:15:49 2022] POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:15:50.095142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:50.108479 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a73b5b4f-6a90-47fc-8f53-d82a401f2e9a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.211618 Sep 22 22:15:50.108936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 298/561] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:49 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:15:51.136684 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:51.138919 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:51.147234 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:51.148254 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:51.149818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:51.150857 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:51.151575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:51.152220 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:51.307280 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:51.316072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-107c17cb-7c33-4f3f-9643-3c05d1d013ca tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.185599 Sep 22 22:15:51.318083 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 264/562] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:51 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:52.340138 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:52.340746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:52.347466 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:52.347954 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:52.348395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:52.349138 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:52.349578 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:52.350007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:52.493541 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:52.502533 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-97a4db5f-d189-4822-8dc6-16fef686316a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.166641 Sep 22 22:15:52.517131 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 299/563] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:52 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:53.593433 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:53.594818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:53.602228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:53.602995 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:53.603593 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:53.604625 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:53.605269 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:53.605851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:53.725852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:53.758092 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:53.810377 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:53.819076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-abccabcc-2a96-4b30-9847-3402a3b670e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.229433 Sep 22 22:15:53.834937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 265/564] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:53 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:54.843207 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:15:54.848074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:54.849048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:54.857704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:54.858459 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:54.860441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:54.861543 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:54.862223 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:54.863030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:55.025357 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:55.033952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5cd9f99b-4a44-4458-a48b-0e7826e1bbc3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.192090 Sep 22 22:15:55.034949 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 300/565] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:54 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:56.058727 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:56.059352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:56.066295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:56.067097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:56.067711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:56.068601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:56.069251 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:56.069837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:56.306351 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:56.315712 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fb93c1ad-f5e5-4c18-b58c-d508aaea50ae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.261542 Sep 22 22:15:56.331215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 266/566] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:56 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:57.341611 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:57.342783 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:57.349851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:57.350879 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:57.351868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:57.352806 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:57.353304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:57.353902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:57.565980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:57.578387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-23aa0932-9c4c-4e25-b550-2219dfc02fae tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.243234 Sep 22 22:15:57.579079 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 301/567] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:57 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:57.804925 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c38400ab-a55f-4ea9-891d-e3a4ff581261 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:15:57.815034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c38400ab-a55f-4ea9-891d-e3a4ff581261 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:57.816079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c38400ab-a55f-4ea9-891d-e3a4ff581261 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:57.817793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c38400ab-a55f-4ea9-891d-e3a4ff581261 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:57.894959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c38400ab-a55f-4ea9-891d-e3a4ff581261 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Going to try to stop instance {{(pid=120662) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 22 22:15:57.956892 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c38400ab-a55f-4ea9-891d-e3a4ff581261 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/action" status: 202 len: 0 microversion: 2.1 time: 0.157510 Sep 22 22:15:57.957883 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 267/568] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:15:57 2022] POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:15:57.972816 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:57.973466 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:57.981173 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:57.982059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:57.982865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:57.984007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:57.984836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:57.985652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:58.191282 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:58.202125 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8a269d18-27ba-428d-836b-f7b210cef0fd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.239305 Sep 22 22:15:58.202718 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 302/569] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:57 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:15:58.608597 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:58.609391 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:58.623758 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:58.624179 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:58.624618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:58.625373 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:58.625835 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:58.628027 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:58.833383 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:58.843356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-32067658-4ced-4848-b4a8-74afbe612d8a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.239452 Sep 22 22:15:58.844709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 268/570] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:58 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:59.228066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:59.230347 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:59.253734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:59.256813 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:59.258128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:59.259581 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:59.259581 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:59.261185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:59.487416 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:15:59.508016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-75aaf30d-64aa-4567-8dd8-bfce91a16614 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.284551 Sep 22 22:15:59.521924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 303/571] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:59 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:15:59.874739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:15:59.876123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:15:59.890030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:59.890727 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:59.891319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:15:59.892191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:15:59.892799 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:15:59.893401 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:00.155950 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:00.167276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-38617b08-07a2-49fa-a4b7-8ae25ade1a0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.302627 Sep 22 22:16:00.169806 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 269/572] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:15:59 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:00.302231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-d8de9a2f-9791-4070-8222-86c0dac3fff6 req-c87ed746-9de3-4a68-b4bf-62567253043c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e642fd-e734-4624-b2be-6fd3141f7a8c", "name": "network-vif-plugged", "status": "completed", "tag": "bdfb86dd-821c-462a-a36c-ab4f3c618d51"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:00.322180 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d8de9a2f-9791-4070-8222-86c0dac3fff6 req-c87ed746-9de3-4a68-b4bf-62567253043c service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:00.323291 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d8de9a2f-9791-4070-8222-86c0dac3fff6 req-c87ed746-9de3-4a68-b4bf-62567253043c service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:00.323903 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d8de9a2f-9791-4070-8222-86c0dac3fff6 req-c87ed746-9de3-4a68-b4bf-62567253043c service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:00.336819 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-d8de9a2f-9791-4070-8222-86c0dac3fff6 req-c87ed746-9de3-4a68-b4bf-62567253043c service nova] Creating event network-vif-plugged:bdfb86dd-821c-462a-a36c-ab4f3c618d51 for instance a9e642fd-e734-4624-b2be-6fd3141f7a8c on hv-cinder-84914 Sep 22 22:16:00.342468 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-d8de9a2f-9791-4070-8222-86c0dac3fff6 req-c87ed746-9de3-4a68-b4bf-62567253043c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044662 Sep 22 22:16:00.343227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 304/573] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:16:00.531900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:00.532662 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:00.542428 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:00.543183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:00.544707 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:00.546755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:00.548874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:00.549765 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:00.846234 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:00.855102 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca4cfc76-c10a-49f5-b5c4-d42cad901c53 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.326931 Sep 22 22:16:00.863395 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 270/574] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:00 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:01.192235 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:01.193206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:01.200333 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:01.201096 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:01.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:01.202599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:01.203064 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:01.203747 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:01.410462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:01.419029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-46f7cd26-5fef-4c8c-8403-2e35273bd0e5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1265 microversion: 2.1 time: 0.230897 Sep 22 22:16:01.429859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 305/575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:01 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:01.879783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:01.880396 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:01.888862 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:01.892619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:01.893139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:01.893927 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:01.896313 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:01.896821 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:02.108716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:02.118098 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f9dddbd3-8e19-4dfb-aeb6-e7611fed2dec tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.241765 Sep 22 22:16:02.134930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 271/576] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:01 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:02.445173 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:02.445918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:02.453458 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=34 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:02.465582 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:02.473957 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:02.474787 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:02.475694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:02.483254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:02.483951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:02.708829 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:02.721973 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6fcff4a1-97a4-4ea8-aa81-47a195a6348c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1452 microversion: 2.1 time: 0.282928 Sep 22 22:16:02.730938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 306/577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:02 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1452 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:02.748081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:02.748837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:02.756057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:02.756637 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:02.757707 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:02.758818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:02.759465 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:02.760073 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:02.972456 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:02.980853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-978f48c5-9b65-4f16-b59e-0b6eb93ea3e1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1452 microversion: 2.1 time: 0.236690 Sep 22 22:16:02.993131 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 272/578] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:02 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1452 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:03.143800 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:03.144399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:03.151703 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:03.152189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:03.152805 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:03.153766 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:03.154212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:03.154855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:03.363043 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:03.375198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8467a33c-fd46-4e7c-959c-c9ebe87e41b4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.233690 Sep 22 22:16:03.375920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 307/579] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:03 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:04.403572 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:04.404192 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:04.411403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:04.412039 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:04.412792 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:04.413902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:04.414555 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:04.415163 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:04.592057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:04.601720 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-de2355b3-498f-4ab0-a349-cf59c996a964 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.205890 Sep 22 22:16:04.603066 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 273/580] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:04 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:05.384279 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-bbfaf541-c907-4765-97d2-79035b670b15 req-f6e37234-3a14-4a9a-b367-a5c130843d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e642fd-e734-4624-b2be-6fd3141f7a8c", "tag": "bdfb86dd-821c-462a-a36c-ab4f3c618d51"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:05.394480 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bbfaf541-c907-4765-97d2-79035b670b15 req-f6e37234-3a14-4a9a-b367-a5c130843d50 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:05.394962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bbfaf541-c907-4765-97d2-79035b670b15 req-f6e37234-3a14-4a9a-b367-a5c130843d50 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:05.395600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-bbfaf541-c907-4765-97d2-79035b670b15 req-f6e37234-3a14-4a9a-b367-a5c130843d50 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:05.412856 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-bbfaf541-c907-4765-97d2-79035b670b15 req-f6e37234-3a14-4a9a-b367-a5c130843d50 service nova] Creating event network-changed:bdfb86dd-821c-462a-a36c-ab4f3c618d51 for instance a9e642fd-e734-4624-b2be-6fd3141f7a8c on hv-cinder-84914 Sep 22 22:16:05.419543 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-bbfaf541-c907-4765-97d2-79035b670b15 req-f6e37234-3a14-4a9a-b367-a5c130843d50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211915 Sep 22 22:16:05.420315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 308/581] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:16:05.626669 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:05.627273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:05.636376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:05.636874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:05.637370 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:05.638084 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:05.643970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:05.644477 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:05.902771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:05.914785 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:05.918572 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-80a8ffd9-7dfd-40f4-a62f-7613e51ec792 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.295846 Sep 22 22:16:05.920707 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 274/582] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:05 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:06.943628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:06.945009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:06.952516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:06.953382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:06.953924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:06.954865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:06.955331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:06.955961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:07.107142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:07.118740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f51e4181-42d5-4fde-bf74-d4d3d8b42da9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.179186 Sep 22 22:16:07.119652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 309/583] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:06 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:08.148970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:08.149695 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:08.157559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:08.158120 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:08.158643 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:08.159433 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:08.163927 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:08.164629 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:08.313642 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:08.321985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-aaf47022-641b-4413-9db0-cb9e10684585 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.177760 Sep 22 22:16:08.322571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 275/584] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:08 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:08.486647 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8c8d0c11-2f9a-4fd9-82cd-f6e45aa26ebc tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Action: 'create', calling method: .version_select at 0x7f405cc26e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-266779907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO00QKygzD+z4ZQFrP/2Fi3HVkXjlSWclKkL0tufbfyvraumAMsTe9jtvGgBLLUh2EvOsmofBRaqlem/W1wA1o70RSPd+bDbaxznP44xVbQeGxwAdL4WNFLvj4lVOMpITA=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:08.502272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-8c8d0c11-2f9a-4fd9-82cd-f6e45aa26ebc tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Getting quotas for project 53f244703dfd4cb29d183025b9d6789e. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:16:08.506074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-8c8d0c11-2f9a-4fd9-82cd-f6e45aa26ebc tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Getting quotas for user 9e819ca5b7e446ff86dc6a47abd88105 and project 53f244703dfd4cb29d183025b9d6789e. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:16:08.527640 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8c8d0c11-2f9a-4fd9-82cd-f6e45aa26ebc tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044839 Sep 22 22:16:08.528227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 310/585] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:16:08 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:16:08.579688 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1565213453", "imageRef": "e8f17a35-f414-4533-a75c-693816a1c579", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-266779907", "networks": [{"uuid": "07b99e2a-cf84-49eb-ad08-c0b8d4b88a58"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:08.631909 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] validate_networks() for [('07b99e2a-cf84-49eb-ad08-c0b8d4b88a58', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:16:09.000827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:16:09.001291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:16:09.001767 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:16:09.002173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:16:09.002580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:16:09.011848 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:09.012356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:09.012787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:09.013539 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:09.013993 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:09.014415 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:09.030911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Getting quotas for project 53f244703dfd4cb29d183025b9d6789e. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:16:09.034895 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Getting quotas for user 9e819ca5b7e446ff86dc6a47abd88105 and project 53f244703dfd4cb29d183025b9d6789e. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:16:09.046329 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:16:09.048544 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8f17a35-f414-4533-a75c-693816a1c579',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:16:09.094998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-094c5e36-e399-41a6-ae77-c519506230b5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519111 Sep 22 22:16:09.095641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 276/586] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:16:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:16:09.106672 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bc57c5b7-4cf6-4b86-bd62-a0d23615e0dd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:09.107290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc57c5b7-4cf6-4b86-bd62-a0d23615e0dd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:09.163685 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bc57c5b7-4cf6-4b86-bd62-a0d23615e0dd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:09.173721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bc57c5b7-4cf6-4b86-bd62-a0d23615e0dd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1258 microversion: 2.1 time: 0.070759 Sep 22 22:16:09.174840 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 311/587] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:09 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:09.350854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:09.352444 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:09.366972 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:09.367474 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:09.368735 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:09.369652 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:09.370415 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:09.371582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:09.513744 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:09.521887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4215b3be-405c-4337-9dc8-7e599f7ac461 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.177688 Sep 22 22:16:09.537292 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 277/588] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:09 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:10.198599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:10.199224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:10.205685 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:10.206170 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:10.206606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:10.207291 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:10.207743 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:10.208165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:10.270875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:10.279324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-08544d29-6b17-4a04-b495-9fc7009cc58f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1310 microversion: 2.1 time: 0.085278 Sep 22 22:16:10.279901 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 312/589] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:10 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:10.545725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:10.546430 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:10.555633 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:10.556124 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:10.556558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:10.557788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:10.557909 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:10.558324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:10.768809 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:10.778374 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1e97aa8a-60ef-45ea-b348-3c623d2a33ff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.236912 Sep 22 22:16:10.779861 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 278/590] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:10 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:11.304988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:11.306732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:11.328539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:11.335287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:11.336146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:11.337202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:11.337875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:11.339031 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:11.516141 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:11.529884 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24f79670-4522-478a-9985-425e39cf1897 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.231233 Sep 22 22:16:11.530917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 313/591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:11 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:11.803772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:11.805180 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:11.813317 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:11.814016 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:11.814724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:11.815543 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:11.816173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:11.816701 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:11.958443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:11.966887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0138059f-bb94-49ca-a82b-d4ffa2f270a7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.167198 Sep 22 22:16:11.967557 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 279/592] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:11 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:12.557732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:12.557732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:12.562153 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:12.562644 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:12.563078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:12.563784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:12.564238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:12.564659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:12.713780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:12.722881 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-39866eac-f32a-42e3-b7cb-42d2995ec4aa tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.172622 Sep 22 22:16:12.723705 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 314/593] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:12 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:12.990657 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:12.991327 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:12.997762 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:12.998244 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:12.998675 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:12.999358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:12.999804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:13.000218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:13.138611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:13.148405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6bd2d32f-2902-4319-9f24-a4f99d2e4f28 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.161571 Sep 22 22:16:13.149334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 280/594] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:12 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:13.746702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:13.747329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:13.753782 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:13.754399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:13.754907 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:13.755731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:13.757091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:13.757640 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:13.773553 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:13.903705 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:13.914408 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f3a5e16a-94cc-4e71-bbbf-e3a881412bf4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.171441 Sep 22 22:16:13.915256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 315/595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:13 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:14.172123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:14.172770 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:14.175036 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:14.181159 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:14.181676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:14.182114 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:14.182821 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:14.183280 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:14.183715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:14.332751 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:14.341982 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9473b15c-f407-4265-a4c1-9eb59aced121 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.173621 Sep 22 22:16:14.351473 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 281/596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:14 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:14.937764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:14.938379 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:14.945772 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:14.946254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:14.946902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:14.947606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:14.948059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:14.948481 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:15.096381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:15.104364 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ae420295-7c87-46b4-b3cf-67b80c5ed63e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.170395 Sep 22 22:16:15.104926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 316/597] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:14 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:15.366788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:15.367354 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:15.374067 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:15.374550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:15.374988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:15.375706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:15.376162 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:15.376586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:15.516448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:15.526552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f2b11e2f-1b51-4e22-b4e2-4a6a3ae9b22f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.164003 Sep 22 22:16:15.527257 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 282/598] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:15 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:15.622055 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9f8a7ee1-a3aa-4fa1-8993-ce04048481e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab8c7488-2cf4-45df-af73-208ab10a1ba7"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:15.624450 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9f8a7ee1-a3aa-4fa1-8993-ce04048481e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:15.630786 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f8a7ee1-a3aa-4fa1-8993-ce04048481e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:15.631419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f8a7ee1-a3aa-4fa1-8993-ce04048481e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:15.632180 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f8a7ee1-a3aa-4fa1-8993-ce04048481e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:15.632938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f8a7ee1-a3aa-4fa1-8993-ce04048481e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:15.633427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f8a7ee1-a3aa-4fa1-8993-ce04048481e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:15.633857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f8a7ee1-a3aa-4fa1-8993-ce04048481e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:16.128988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:16.129637 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:16.136980 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:16.137853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:16.138314 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:16.139023 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:16.139642 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:16.140077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:16.277501 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:16.285240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3e8e7d44-bc04-4ae9-86a9-4de380e290d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.161087 Sep 22 22:16:16.285811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 283/599] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:16 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:16.550748 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:16.551384 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:16.558574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:16.559066 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:16.559493 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:16.560388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:16.560840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:16.561332 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:16.725992 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:16.734315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e6f830e0-9b9d-4bce-a7d6-c0268fba3598 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.187305 Sep 22 22:16:16.734822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 284/600] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:16 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:17.308419 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:17.309151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:17.317133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:17.317623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:17.318062 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:17.318934 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:17.319758 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:17.320211 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:17.453220 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:17.461629 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e998cd58-b5ea-4608-a41a-ee139b23d4bf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.157173 Sep 22 22:16:17.462206 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 285/601] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:17 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:17.759321 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:17.760001 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:17.767031 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:17.767581 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:17.768234 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:17.769236 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:17.769910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:17.770645 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:17.910579 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:17.919153 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9f4cb562-c8de-4997-8212-c5f0f3fbbf2f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.164410 Sep 22 22:16:17.919725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 286/602] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:17 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:18.486123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:18.487132 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:18.496784 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:18.497328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:18.497768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:18.498521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:18.499013 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:18.499472 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:18.636656 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:18.644531 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-35c8dee3-97f3-494f-a501-c988b8e6594f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.162536 Sep 22 22:16:18.645324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 287/603] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:18 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:18.944327 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:18.945405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:18.951900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:18.952384 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:18.952833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:18.953548 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:18.954003 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:18.954426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:19.021493 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:19.046274 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:19.100458 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:19.110372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-931dc8bf-bcd1-4901-9aba-163f32a63def tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.170527 Sep 22 22:16:19.111265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 288/604] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:18 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:19.173215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:19.667972 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:19.668827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:19.674959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:19.675543 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:19.676054 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:19.676820 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:19.677368 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:19.677790 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:19.836309 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:19.844781 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-863b877b-3799-4db7-87a8-dc64f71f095e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.181209 Sep 22 22:16:19.845406 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 289/605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:19 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:20.134885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:20.135569 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:20.142141 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:20.142623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:20.143057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:20.143746 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:20.144197 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:20.144619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:20.283007 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:20.291566 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f27cda7a-b7d8-4e3d-909b-a158ae3b3af9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.160696 Sep 22 22:16:20.292571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 290/606] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:20 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:20.868378 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:20.868996 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:20.875156 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:20.875621 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:20.876064 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:20.876774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:20.877517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:20.877719 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:21.018277 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:21.026495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dfd3fe58-5d4f-4c87-8812-66efc0f6e5f7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.162457 Sep 22 22:16:21.027070 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 291/607] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:20 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:21.317752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:21.318516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:21.325443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:21.325926 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:21.326357 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:21.327047 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:21.327521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:21.327937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:21.331826 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:21.461205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:21.469121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a87edb2b-8e73-428d-aad3-9eda14592fa0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.155740 Sep 22 22:16:21.469689 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 292/608] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:21 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:22.048944 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:22.049589 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:22.055731 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:22.056220 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:22.056660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:22.057392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:22.057853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:22.058281 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:22.184953 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:22.192743 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-19f75bbb-2cb1-4598-bce3-c4a35b813fa3 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.147696 Sep 22 22:16:22.193336 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 293/609] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:22 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:22.492834 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:22.493524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:22.500774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:22.501287 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:22.501716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:22.502407 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:22.502851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:22.503267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:22.636458 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:22.650886 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5d31816a-ba6b-4f2f-8895-e22785007f21 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.161951 Sep 22 22:16:22.651469 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 294/610] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:22 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:23.216649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:23.217621 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:23.224454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:23.224932 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:23.225394 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:23.226082 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:23.227148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:23.227578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:23.355252 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:23.362795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c431a049-d36a-4cc5-81e6-4c0a2514f914 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.150108 Sep 22 22:16:23.363361 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 295/611] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:23 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:23.675624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:23.676270 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:23.682851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:23.683330 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:23.683762 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:23.684458 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:23.684911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:23.685370 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:24.131006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9f8a7ee1-a3aa-4fa1-8993-ce04048481e7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.634348 Sep 22 22:16:24.131616 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 317/612] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:16:15 2022] POST /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments => generated 194 bytes in 8636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:16:24.267311 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:24.278155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7243ebd4-fea2-4f2a-9727-544aefb7d274 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1724 microversion: 2.1 time: 0.605912 Sep 22 22:16:24.289168 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 296/613] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:23 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1724 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:24.387547 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:24.388272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:24.395935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:24.396462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:24.396897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:24.397698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:24.398066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:24.399150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:24.732795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:24.741237 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-53557af9-ef0c-42c9-b6c2-de3c0e2f9494 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.358662 Sep 22 22:16:24.753161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 318/614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:24 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:25.274910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-3c79d411-f0b8-4aec-a6b4-fed89241ddc0 req-c33928a3-3880-42e2-a9d6-0b3b054b500a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8aead4-e4e9-4733-8351-1be87fd84dff", "tag": "ad1f6820-de7a-484b-a76f-cd05b1b0347d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:25.292147 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-3c79d411-f0b8-4aec-a6b4-fed89241ddc0 req-c33928a3-3880-42e2-a9d6-0b3b054b500a service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:25.292618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-3c79d411-f0b8-4aec-a6b4-fed89241ddc0 req-c33928a3-3880-42e2-a9d6-0b3b054b500a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:25.293290 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-3c79d411-f0b8-4aec-a6b4-fed89241ddc0 req-c33928a3-3880-42e2-a9d6-0b3b054b500a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:25.302410 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:25.303082 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:25.304571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-3c79d411-f0b8-4aec-a6b4-fed89241ddc0 req-c33928a3-3880-42e2-a9d6-0b3b054b500a service nova] Creating event network-changed:ad1f6820-de7a-484b-a76f-cd05b1b0347d for instance cd8aead4-e4e9-4733-8351-1be87fd84dff on hv-cinder-84914 Sep 22 22:16:25.310237 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-3c79d411-f0b8-4aec-a6b4-fed89241ddc0 req-c33928a3-3880-42e2-a9d6-0b3b054b500a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039431 Sep 22 22:16:25.310427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:25.310779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:25.311214 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:25.311462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 297/615] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:16:25.312317 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:25.312807 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:25.313258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:25.476365 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:25.484904 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fa39e4ff-3ae2-490f-a5f4-7376a009386b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1701 microversion: 2.1 time: 0.186641 Sep 22 22:16:25.485497 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 319/616] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:25 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1701 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:25.508950 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5675a2b4-e702-4beb-8171-75d95f11e203 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:25.515129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5675a2b4-e702-4beb-8171-75d95f11e203 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:25.515597 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5675a2b4-e702-4beb-8171-75d95f11e203 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:25.516019 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5675a2b4-e702-4beb-8171-75d95f11e203 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:25.537085 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5675a2b4-e702-4beb-8171-75d95f11e203 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Going to try to start instance {{(pid=120662) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 22 22:16:25.578843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5675a2b4-e702-4beb-8171-75d95f11e203 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/action" status: 202 len: 0 microversion: 2.1 time: 0.074451 Sep 22 22:16:25.579360 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 298/617] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:16:25 2022] POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:16:25.587580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:25.588185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:25.594101 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:25.594577 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:25.595014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:25.595734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:25.596186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:25.596612 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:25.765563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:25.766267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:25.768835 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:25.772452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:25.773048 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:25.774007 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:25.774942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:25.775606 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:25.776232 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:25.777553 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-56901930-967a-4d5d-a3c0-9c48c64cf269 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1710 microversion: 2.1 time: 0.193810 Sep 22 22:16:25.778127 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 320/618] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:25 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1710 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:26.039726 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:26.048382 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8446d0b7-56d7-45b5-a2b4-6d49a61a2017 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.287030 Sep 22 22:16:26.050006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 299/619] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:25 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:26.801633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:26.802190 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:26.808744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:26.809258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:26.809690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:26.810423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:26.810863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:26.811276 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:26.947790 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:26.956005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d7e7b566-5f98-48a7-8fe4-4ca70cf567e4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1710 microversion: 2.1 time: 0.158327 Sep 22 22:16:26.956569 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 321/620] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:26 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:27.075501 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:27.076113 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:27.082534 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:27.083020 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:27.083459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:27.084146 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:27.084603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:27.085026 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:27.211904 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:27.219484 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8d1b965c-5284-4fd1-830e-db533e32be58 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.148067 Sep 22 22:16:27.220043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 300/621] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:27 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:27.983752 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:27.984294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:27.990658 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:27.991133 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:27.991561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:27.993132 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:27.993642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:27.994015 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:28.124780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:28.133036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1ad9b69a-da72-4713-8ce8-53d84616905d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1710 microversion: 2.1 time: 0.153228 Sep 22 22:16:28.133624 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 322/622] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:27 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:28.245200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:28.245764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:28.252081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:28.252575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:28.253010 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:28.253728 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:28.254178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:28.254598 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:28.381399 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:28.389583 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d8e23f6a-4288-409c-8f1c-516981dba65d tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.148949 Sep 22 22:16:28.390175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 301/623] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:28 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:29.156256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:29.156776 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:29.163108 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:29.163595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:29.164599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:29.165328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:29.165783 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:29.166206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:29.413057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:29.413659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:29.421363 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:29.421847 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:29.422282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:29.422982 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:29.423434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:29.423855 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:29.738717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:29.747446 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8ab7be40-0859-4dd5-a4dd-0bcb34f660b2 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1710 microversion: 2.1 time: 0.595091 Sep 22 22:16:29.748027 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 323/624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:29 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1710 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:29.759727 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:29.768047 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ab585d77-2a1a-4b68-aeff-95e0f485c027 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.358956 Sep 22 22:16:29.768939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 302/625] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:29 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:30.771862 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:30.772429 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:30.779445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:30.779927 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:30.780364 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:30.781049 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:30.781534 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:30.781959 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:30.791892 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:30.792535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:30.798832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:30.799313 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:30.799741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:30.800430 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:30.800897 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:30.801331 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:30.988815 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:30.994689 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:31.004841 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c60361fd-b25c-4550-9f54-ec3beb8f3ee2 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.216910 Sep 22 22:16:31.005920 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 303/626] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:30 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:31.009465 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd5c8f54-309c-4aa4-a11f-7582567d1129 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1710 microversion: 2.1 time: 0.241333 Sep 22 22:16:31.021574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 324/627] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:30 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1710 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:32.029393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:32.030008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:32.036442 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:32.036609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:32.037052 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:32.037189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:32.037379 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:32.038086 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:32.038646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:32.039154 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:32.044085 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:32.044627 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:32.045071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:32.045835 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:32.046304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:32.046730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:32.254907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:32.260897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:32.264088 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6e73d8ef-462d-4fb1-a410-8070990e7931 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.238713 Sep 22 22:16:32.264675 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 304/628] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:32 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:32.272153 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e3e4627e-a02b-405b-a119-686a6dc84d42 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1714 microversion: 2.1 time: 0.240331 Sep 22 22:16:32.272964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 325/629] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:32 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1714 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:32.475577 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-563bfc8f-822e-4aa3-a475-536ca0b1565e req-de8b7fc1-a808-4336-aec9-564943f50f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8aead4-e4e9-4733-8351-1be87fd84dff", "name": "network-vif-plugged", "status": "completed", "tag": "ad1f6820-de7a-484b-a76f-cd05b1b0347d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:32.486590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-563bfc8f-822e-4aa3-a475-536ca0b1565e req-de8b7fc1-a808-4336-aec9-564943f50f0f service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:32.487072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-563bfc8f-822e-4aa3-a475-536ca0b1565e req-de8b7fc1-a808-4336-aec9-564943f50f0f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:32.487499 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-563bfc8f-822e-4aa3-a475-536ca0b1565e req-de8b7fc1-a808-4336-aec9-564943f50f0f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:32.501162 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-563bfc8f-822e-4aa3-a475-536ca0b1565e req-de8b7fc1-a808-4336-aec9-564943f50f0f service nova] Creating event network-vif-plugged:ad1f6820-de7a-484b-a76f-cd05b1b0347d for instance cd8aead4-e4e9-4733-8351-1be87fd84dff on hv-cinder-84914 Sep 22 22:16:32.506696 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-563bfc8f-822e-4aa3-a475-536ca0b1565e req-de8b7fc1-a808-4336-aec9-564943f50f0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095608 Sep 22 22:16:32.507713 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 305/630] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:16:32.750022 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:32.752442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:32.754417 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:32.759890 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:32.760372 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:32.760803 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:32.761529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:32.761980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:32.762397 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:32.785246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lazy-loading 'flavor' on Instance uuid 508fe0c2-63f2-443d-b1a6-594aac42f259 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:16:32.906201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0034c036-253c-4c9e-b8c8-37be69a3bb6a tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/action" status: 200 len: 32 microversion: 2.1 time: 0.160035 Sep 22 22:16:32.906718 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 326/631] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:16:32 2022] POST /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 22:16:32.917808 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:32.918501 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:32.924804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:32.925324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:32.925754 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:32.926436 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:32.926885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:32.927297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:33.060952 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:33.069355 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3feabdca-453c-49e4-a5a2-d2aefa75712d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.156604 Sep 22 22:16:33.070048 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 306/632] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:32 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:33.287496 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:33.288238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:33.295358 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:33.295844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:33.296282 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:33.297002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:33.297482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:33.297907 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:33.424850 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:33.433082 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eaa23b57-6888-47fe-baba-18f5f1b1da4b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1358 microversion: 2.1 time: 0.150294 Sep 22 22:16:33.433659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 327/633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:33 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:34.092529 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:34.093255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:34.099749 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:34.100306 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:34.100958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:34.101858 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:34.102389 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:34.102902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:34.284986 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:34.293655 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f636c594-ff31-411f-ba25-4d6cd0cc2f02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.205082 Sep 22 22:16:34.294232 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 307/634] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:34 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:34.456002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:34.456606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:34.463103 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:34.463578 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:34.464037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:34.464717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:34.465192 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:34.465615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:34.598220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:34.600493 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:34.608381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bacbada9-4d64-4f9d-89af-33a7d1123f80 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1548 microversion: 2.1 time: 0.156191 Sep 22 22:16:34.608935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 328/635] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:34 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:34.630931 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:34.631532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:34.638122 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:34.638593 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:34.639020 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:34.639693 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:34.640139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:34.640558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:34.764336 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:34.772048 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3322f92a-5230-4121-b678-c43636b4a731 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1548 microversion: 2.1 time: 0.144842 Sep 22 22:16:34.772672 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 308/636] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:34 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:34.794474 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:34.799285 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:34.799969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Searching by: {'deleted': False, 'project_id': '53f244703dfd4cb29d183025b9d6789e'} {{(pid=120663) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 22 22:16:34.808175 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:34.808654 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:34.809078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:34.809846 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:34.810292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:34.810742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:34.900793 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.multi_cell_list [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120663) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 22 22:16:34.995197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3983ea44-c5ee-4bbb-927c-d8d065de3d7a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204605 Sep 22 22:16:34.995774 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 329/637] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Sep 22 22:16:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:16:35.007255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:35.007870 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:35.013755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:35.014230 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:35.014666 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:35.015443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:35.015925 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:35.016349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:35.019023 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:35.149379 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:35.157053 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6f580dc8-e46f-4862-ab43-49118a70030b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1548 microversion: 2.1 time: 0.153739 Sep 22 22:16:35.157641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 309/638] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:35 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:35.317579 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:35.318115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:35.324186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:35.324678 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:35.325097 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:35.325817 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:35.326384 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:35.326695 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:35.472869 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:35.481565 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cd5125cc-3fbb-45a1-a4a3-c3ba6e6967fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.167854 Sep 22 22:16:35.482135 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 330/639] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:35 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:36.506235 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:36.507381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:36.513767 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:36.514337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:36.514717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:36.515375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:36.515829 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:36.516247 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:36.660665 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:36.669703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ca05461c-e6c5-4cd1-ab5e-e7b74ef69467 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.167271 Sep 22 22:16:36.670354 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 310/640] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:36 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:36.705139 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2fd5190d-72ec-4243-8a61-8d1dce82ad9f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5688695b-89dd-420b-9551-f97fca368353"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:36.707535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2fd5190d-72ec-4243-8a61-8d1dce82ad9f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:36.713933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd5190d-72ec-4243-8a61-8d1dce82ad9f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:36.714408 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd5190d-72ec-4243-8a61-8d1dce82ad9f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:36.714830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd5190d-72ec-4243-8a61-8d1dce82ad9f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:36.715502 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd5190d-72ec-4243-8a61-8d1dce82ad9f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:36.715945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd5190d-72ec-4243-8a61-8d1dce82ad9f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:36.716359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2fd5190d-72ec-4243-8a61-8d1dce82ad9f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:36.990561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2fd5190d-72ec-4243-8a61-8d1dce82ad9f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "POST /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289140 Sep 22 22:16:36.991849 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 331/641] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:16:36 2022] POST /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:16:37.693971 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:37.694690 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:37.701415 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:37.701897 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:37.702355 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:37.703050 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:37.703501 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:37.703935 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:37.839877 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:37.848016 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-56972166-d327-4e83-92b2-78a57d502ffe tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.158051 Sep 22 22:16:37.848588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 311/642] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:37 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:38.873034 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:38.873759 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:38.879852 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:38.880328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:38.880767 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:38.881478 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:38.882583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:38.883001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:39.009557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:39.017576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-da12a2bc-dd9c-4fc5-9961-37f33380a449 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.149212 Sep 22 22:16:39.018131 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 332/643] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:38 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:40.040240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:40.040850 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:40.047372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:40.047850 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:40.048281 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:40.048963 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:40.049439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:40.049865 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:40.179584 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:40.187742 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2d1aedbf-edef-411b-9dd5-96a530efa022 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.151351 Sep 22 22:16:40.188580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 312/644] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:40 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:41.212197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:41.212795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:41.219268 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:41.219745 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:41.220180 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:41.220854 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:41.221345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:41.221767 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:41.353458 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:41.361563 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-96168914-9a3e-40d8-b4a2-1f8f127a124c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.153724 Sep 22 22:16:41.362133 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 333/645] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:41 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:42.385596 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:42.386197 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:42.392478 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:42.392952 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:42.393420 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:42.394097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:42.394544 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:42.394959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:42.527443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:42.535607 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-86a41734-95c9-4090-bf1b-d4a7d66a1615 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.154420 Sep 22 22:16:42.536163 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 313/646] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:42 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:43.559906 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:43.560512 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:43.566921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:43.567467 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:43.567907 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:43.568605 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:43.569695 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:43.570291 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:43.703387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:43.712416 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-06e9fe0c-df65-44f4-af8a-2e5014e8082d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.156445 Sep 22 22:16:43.712985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 334/647] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:43 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:44.596613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:44.597260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:44.599638 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=66 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:44.605572 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:44.606058 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:44.606497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:44.607191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:44.607644 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:44.608072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:44.736211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:44.736897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:44.737322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:44.744246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:44.744734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:44.745196 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:44.745947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:44.746344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5a4e7d0c-825c-4e2e-a465-a4a557b7a558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1594 microversion: 2.1 time: 0.153496 Sep 22 22:16:44.746449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:44.746800 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:44.746911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 314/648] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:44 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:44.841326 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:16:44.892617 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:44.901867 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6b9b92e3-b129-4d6c-88db-8243b30b0395 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.169738 Sep 22 22:16:44.902443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 335/649] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:44 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:45.925810 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:45.926420 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:45.933171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:45.933652 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:45.934081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:45.934766 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:45.935216 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:45.935634 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:46.066024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:46.074390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8f180e9d-648e-4e10-b0b7-f6c32a6817db tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.152391 Sep 22 22:16:46.074960 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 315/650] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:45 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:46.655761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-a26e82cf-f0bd-4797-b5da-8b77687a3241 req-6be88d96-6f4a-4ecb-a640-904a05f2847e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8aead4-e4e9-4733-8351-1be87fd84dff", "tag": "ad1f6820-de7a-484b-a76f-cd05b1b0347d"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:46.665742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-a26e82cf-f0bd-4797-b5da-8b77687a3241 req-6be88d96-6f4a-4ecb-a640-904a05f2847e service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:46.666472 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-a26e82cf-f0bd-4797-b5da-8b77687a3241 req-6be88d96-6f4a-4ecb-a640-904a05f2847e service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:46.666899 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-a26e82cf-f0bd-4797-b5da-8b77687a3241 req-6be88d96-6f4a-4ecb-a640-904a05f2847e service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:46.682712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-a26e82cf-f0bd-4797-b5da-8b77687a3241 req-6be88d96-6f4a-4ecb-a640-904a05f2847e service nova] Creating event network-changed:ad1f6820-de7a-484b-a76f-cd05b1b0347d for instance cd8aead4-e4e9-4733-8351-1be87fd84dff on hv-cinder-84914 Sep 22 22:16:46.687703 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-a26e82cf-f0bd-4797-b5da-8b77687a3241 req-6be88d96-6f4a-4ecb-a640-904a05f2847e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035455 Sep 22 22:16:46.688619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 336/651] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:16:47.099089 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:47.100544 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:47.109149 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:47.110288 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:47.111260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:47.112174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:47.112885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:47.113975 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:47.349836 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:47.360937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3cf50c76-61fd-49f4-bfbc-ca590ebb410d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.265740 Sep 22 22:16:47.362096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 316/652] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:47 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:47.769035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-378607518"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:47.769855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:47.777253 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:47.777737 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:47.778168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:47.778863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:47.779313 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:47.779732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:47.914226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.network.security_group_api [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Adding security group 90e26c09-bad4-45d7-8865-b81a4507eb15 to port ad1f6820-de7a-484b-a76f-cd05b1b0347d Sep 22 22:16:48.247671 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fb8c6ae2-8e94-4624-af98-15fd54e75b99 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "POST /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/action" status: 202 len: 0 microversion: 2.1 time: 0.483292 Sep 22 22:16:48.248278 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 337/653] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:16:47 2022] POST /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:16:48.255631 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-e455254f-02dd-493a-aba6-6b8aa6596476 req-7be4e77c-22fe-44b5-bdff-ad9d083f6abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8aead4-e4e9-4733-8351-1be87fd84dff", "tag": "ad1f6820-de7a-484b-a76f-cd05b1b0347d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:16:48.265579 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:48.266181 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:48.273946 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:48.274698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:48.275098 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e455254f-02dd-493a-aba6-6b8aa6596476 req-7be4e77c-22fe-44b5-bdff-ad9d083f6abb service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:48.275475 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:48.275623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e455254f-02dd-493a-aba6-6b8aa6596476 req-7be4e77c-22fe-44b5-bdff-ad9d083f6abb service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:48.275999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-e455254f-02dd-493a-aba6-6b8aa6596476 req-7be4e77c-22fe-44b5-bdff-ad9d083f6abb service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:48.276609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:48.277248 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:48.277820 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:48.287654 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-e455254f-02dd-493a-aba6-6b8aa6596476 req-7be4e77c-22fe-44b5-bdff-ad9d083f6abb service nova] Creating event network-changed:ad1f6820-de7a-484b-a76f-cd05b1b0347d for instance cd8aead4-e4e9-4733-8351-1be87fd84dff on hv-cinder-84914 Sep 22 22:16:48.294101 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-e455254f-02dd-493a-aba6-6b8aa6596476 req-7be4e77c-22fe-44b5-bdff-ad9d083f6abb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041969 Sep 22 22:16:48.295018 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 317/654] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:16:48.386697 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:48.387399 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:48.393856 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:48.394352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:48.394794 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:48.395936 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:48.396403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:48.397017 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:48.550815 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:48.560119 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5fd5de15-7830-4a93-a3c6-254bdb271292 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1758 microversion: 2.1 time: 0.298123 Sep 22 22:16:48.560773 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 338/655] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:48 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1758 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:48.641401 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:48.651057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3cf3221c-3abb-44e7-b2be-801f8b6e07ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.268879 Sep 22 22:16:48.651731 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 318/656] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:48 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:16:49.675126 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:49.675737 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:49.682863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:49.683343 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:49.683774 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:49.684459 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:49.684906 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:49.685352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:49.817724 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:49.826235 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-aa76c70c-6f95-4991-83e5-fa99ce39e154 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.154967 Sep 22 22:16:49.826807 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 339/657] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:49 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:50.849611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:50.850196 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:50.856692 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:50.857197 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:50.857626 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:50.858303 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:50.858755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:50.859173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:50.987135 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:50.995872 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-058af64c-015e-4410-8335-65d82e8e5069 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.150077 Sep 22 22:16:50.996439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 319/658] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:50 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:52.019667 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:52.020304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:52.027300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:52.027787 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:52.028221 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:52.028906 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:52.029381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:52.029807 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:52.156682 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:52.164747 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d3159fa0-ddbc-4c4d-9060-2382246cb89e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.148915 Sep 22 22:16:52.165338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 340/659] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:52 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:53.187824 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:53.188433 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:53.194861 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:53.195330 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:53.195761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:53.196441 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:53.196891 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:53.197332 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:53.325119 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:53.333301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0b4e2971-e79c-476e-8878-d930f6dac2f2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.149340 Sep 22 22:16:53.333876 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 320/660] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:53 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:54.357626 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:54.358159 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:54.364513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:54.364999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:54.365467 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:54.367057 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:54.367620 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:54.368049 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:54.493863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:54.501894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-68800a4c-a509-4d79-b014-a1e492dca921 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.148188 Sep 22 22:16:54.502448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 341/661] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:54 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:55.525123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:55.525748 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:55.532256 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:55.532730 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:55.533287 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:55.533971 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:55.534422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:55.534841 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:55.659930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:55.668251 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-69f91d10-7d1b-4b63-a086-e389c8030948 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.147058 Sep 22 22:16:55.668812 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 321/662] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:55 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:56.691645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:56.692280 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:56.699416 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:56.699897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:56.700328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:56.701016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:56.701507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:56.701932 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:56.832080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:56.840218 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-30656232-92d4-4005-b679-5e58a3df702b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.152380 Sep 22 22:16:56.840782 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 342/663] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:56 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:57.863595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:57.864253 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:57.871231 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:57.871739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:57.872177 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:57.872888 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:57.873409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:57.873859 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:58.004312 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:58.013186 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6aff17d0-562b-41f9-ac99-a7b17b232262 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.153553 Sep 22 22:16:58.013754 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 322/664] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:57 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:16:59.038579 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:16:59.039264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:16:59.046842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:59.047329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:59.049667 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:59.050382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:16:59.050843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:16:59.051296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:16:59.192864 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:16:59.202269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cbad0e47-2ec9-4a49-923b-6ea413f941a0 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1735 microversion: 2.1 time: 0.168006 Sep 22 22:16:59.202848 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 343/665] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:16:59 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:00.232517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:00.233191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:00.239680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:00.240161 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:00.240624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:00.242000 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:00.242450 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:00.242875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:00.373214 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:00.381464 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8a584c73-21c3-4b8c-9e9f-2307b6e08421 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1715 microversion: 2.1 time: 0.155164 Sep 22 22:17:00.382112 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 323/666] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:00 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:17:00.443073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:00.443550 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:00.450029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:00.450506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:00.450944 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:00.451628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:00.452081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:00.452502 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:00.573700 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:00.584954 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] HTTP exception thrown: Cannot 'detach_volume' instance 508fe0c2-63f2-443d-b1a6-594aac42f259 while it is in vm_state rescued Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Request method failure captured: Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments/ab8c7488-2cf4-45df-af73-208ab10a1ba7 HTTP/1.1 Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1MwaNckOyBXrl2li1Wzti5__EIIu_hQ71URQjXNxaSZLgxsPx47PdZhEErbdvvOH1NrgTqx4PXvZ3GkkpZIv1qXRWw76GInH6xlbrSFAXJ957yGl9VLt68K55_b1yCGudQh9z-LJZ0LUKJIFYiuxgvsttGS5_gwxD9er05GWlixn4 Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:17:00.586689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0499a794df4444b594ee3126a8e210c1", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: ca01fc46c837486b808390ff0c48fa1f Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:17:00.588292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Cannot 'detach_volume' instance 508fe0c2-63f2-443d-b1a6-594aac42f259 while it is in vm_state rescued Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'server_id': '508fe0c2-63f2-443d-b1a6-594aac42f259', 'id': 'ab8c7488-2cf4-45df-af73-208ab10a1ba7'} Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 508fe0c2-63f2-443d-b1a6-594aac42f259 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:17:00.589157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 508fe0c2-63f2-443d-b1a6-594aac42f259 while it is in vm_state rescued Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 508fe0c2-63f2-443d-b1a6-594aac42f259 while it is in vm_state rescued Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:00.590757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Returning 409 to user: Cannot 'detach_volume' instance 508fe0c2-63f2-443d-b1a6-594aac42f259 while it is in vm_state rescued {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:17:00.591911 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-486da2eb-a071-4e83-841b-cb3e06dbd1fa tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "DELETE /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments/ab8c7488-2cf4-45df-af73-208ab10a1ba7" status: 409 len: 152 microversion: 2.1 time: 0.149040 Sep 22 22:17:00.591911 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 344/667] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:17:00 2022] DELETE /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments/ab8c7488-2cf4-45df-af73-208ab10a1ba7 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 22 22:17:00.596861 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6e0d2a66-79dd-472d-b4c8-a383cfc588bd tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:00.597408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6e0d2a66-79dd-472d-b4c8-a383cfc588bd tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:00.603906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a66-79dd-472d-b4c8-a383cfc588bd tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:00.604378 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a66-79dd-472d-b4c8-a383cfc588bd tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:00.604805 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a66-79dd-472d-b4c8-a383cfc588bd tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:00.605512 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a66-79dd-472d-b4c8-a383cfc588bd tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:00.605960 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a66-79dd-472d-b4c8-a383cfc588bd tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:00.606376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a66-79dd-472d-b4c8-a383cfc588bd tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:00.671153 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6e0d2a66-79dd-472d-b4c8-a383cfc588bd tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "POST /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/action" status: 202 len: 0 microversion: 2.1 time: 0.077900 Sep 22 22:17:00.671771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 324/668] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:17:00 2022] POST /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:17:00.681677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:00.682594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:00.689406 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:00.690167 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:00.690649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:00.691559 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:00.692019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:00.692518 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:01.139912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:01.149516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-31cd77e7-7bfe-4d7f-89ce-3b3b817116f4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1723 microversion: 2.1 time: 0.473217 Sep 22 22:17:01.150091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 345/669] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:00 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1723 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:17:02.174391 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:02.175086 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:02.181243 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:02.181727 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:02.182182 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:02.182867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:02.183321 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:02.183739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:02.200156 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:02.319493 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:02.327622 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ee481ac9-871b-42cc-bff9-68bf5ac289e4 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1723 microversion: 2.1 time: 0.158164 Sep 22 22:17:02.328165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 325/670] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:02 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:03.352360 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:03.352905 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:03.355489 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=40 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:03.361331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:03.361850 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:03.362318 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:03.363006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:03.363458 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:03.363886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:03.496425 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:03.504570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-76b52704-e06a-489b-89bb-aec009c6300e tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1723 microversion: 2.1 time: 0.156914 Sep 22 22:17:03.506128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 346/671] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:03 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:04.527716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:04.528317 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:04.534952 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.535432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.535857 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:04.536537 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.536984 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.537428 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:04.640510 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-67fcb4dd-3f5b-463e-8b24-c9eb44ffa9ef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:04.641082 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-67fcb4dd-3f5b-463e-8b24-c9eb44ffa9ef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:04.643280 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 22:17:04.643414 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Thu Sep 22 22:17:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c/ips (ip 10.222.0.25) !!! Sep 22 22:17:04.649803 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcb4dd-3f5b-463e-8b24-c9eb44ffa9ef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.650287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcb4dd-3f5b-463e-8b24-c9eb44ffa9ef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.650719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcb4dd-3f5b-463e-8b24-c9eb44ffa9ef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:04.651409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcb4dd-3f5b-463e-8b24-c9eb44ffa9ef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.651857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcb4dd-3f5b-463e-8b24-c9eb44ffa9ef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.652273 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67fcb4dd-3f5b-463e-8b24-c9eb44ffa9ef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:04.671305 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:04.676949 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-67fcb4dd-3f5b-463e-8b24-c9eb44ffa9ef tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c/ips" status: 200 len: 149 microversion: 2.1 time: 0.040217 Sep 22 22:17:04.677548 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 347/672] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:17:04 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:17:04.679983 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e7030f8c-aeba-4e9f-ad4b-ccec6dd837e1 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1723 microversion: 2.1 time: 0.155489 Sep 22 22:17:04.680541 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 326/673] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:04 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:04.689303 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49ad5890-b87e-4061-af3b-05c4d050ea04"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:04.691662 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:04.697764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.698238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.698669 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:04.699338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.699786 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.700200 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:04.776828 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Invalid volume: volume 49ad5890-b87e-4061-af3b-05c4d050ea04 is already attached to instances: 765e0b40-b687-4b25-b264-0b84e9d0a8a3 Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: POST /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c/os-volume_attachments HTTP/1.1 Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 74 Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:17:04.778572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {"volumeAttachment": {"volumeId": "49ad5890-b87e-4061-af3b-05c4d050ea04"}} Sep 22 22:17:04.780088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Invalid volume: volume 49ad5890-b87e-4061-af3b-05c4d050ea04 is already attached to instances: 765e0b40-b687-4b25-b264-0b84e9d0a8a3 Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'server_id': '60e7432c-e9dc-49c3-a476-991a48adde7c', 'body': {'volumeAttachment': {'volumeId': '49ad5890-b87e-4061-af3b-05c4d050ea04'}}} Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 49ad5890-b87e-4061-af3b-05c4d050ea04 is already attached to instances: 765e0b40-b687-4b25-b264-0b84e9d0a8a3 Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:04.780972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 49ad5890-b87e-4061-af3b-05c4d050ea04 is already attached to instances: 765e0b40-b687-4b25-b264-0b84e9d0a8a3 Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:04.782149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:17:04.783330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:17:04.783330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:17:04.783330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:17:04.783330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 49ad5890-b87e-4061-af3b-05c4d050ea04 is already attached to instances: 765e0b40-b687-4b25-b264-0b84e9d0a8a3 Sep 22 22:17:04.783330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:04.783330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 400 to user: Invalid volume: volume 49ad5890-b87e-4061-af3b-05c4d050ea04 is already attached to instances: 765e0b40-b687-4b25-b264-0b84e9d0a8a3 {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:17:04.783330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1e3b51e2-99ca-4338-b300-1a25d083c57b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094332 Sep 22 22:17:04.783330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 348/674] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:17:04 2022] POST /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 22:17:04.789530 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:04.790019 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:04.796026 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.796504 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.796934 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:04.797641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.798090 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.798506 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:04.823547 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:17:04.895778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-efd34d7b-5e61-4929-911f-c10f5e5db75e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 204 len: 0 microversion: 2.1 time: 0.110330 Sep 22 22:17:04.896355 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 327/675] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:17:04 2022] DELETE /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:17:04.904513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:04.905147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:04.914988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.915731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.916171 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:04.916869 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:04.917355 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:04.917791 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:05.048570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:05.056974 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-53a02a50-8c3d-45fc-a605-5482f936459b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1680 microversion: 2.1 time: 0.156232 Sep 22 22:17:05.057594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 349/676] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:04 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:05.703195 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:05.703896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:05.710870 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:05.711367 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:05.711801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:05.712491 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:05.712954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:05.713411 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:05.847520 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:05.855908 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-977a845c-e32c-4eab-9e14-5c5d3c9f3c02 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1729 microversion: 2.1 time: 0.156918 Sep 22 22:17:05.856479 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 328/677] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:05 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:05.878923 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-020ce32f-3c0d-4599-86f7-58aafc33c612 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:05.879399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-020ce32f-3c0d-4599-86f7-58aafc33c612 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:05.886518 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-020ce32f-3c0d-4599-86f7-58aafc33c612 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:05.887009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-020ce32f-3c0d-4599-86f7-58aafc33c612 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:05.887453 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-020ce32f-3c0d-4599-86f7-58aafc33c612 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:05.888149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-020ce32f-3c0d-4599-86f7-58aafc33c612 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:05.888608 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-020ce32f-3c0d-4599-86f7-58aafc33c612 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:05.889039 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-020ce32f-3c0d-4599-86f7-58aafc33c612 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:05.964046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-020ce32f-3c0d-4599-86f7-58aafc33c612 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088872 Sep 22 22:17:05.964635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 350/678] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 22 22:17:05 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:06.081677 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:06.082285 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:06.088196 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:06.088675 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:06.089130 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:06.089826 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:06.090278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:06.090705 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:06.322085 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:06.329633 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e4b835b4-3693-42f5-abfc-22910b871cb7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1680 microversion: 2.1 time: 0.251895 Sep 22 22:17:06.330211 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 329/679] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:06 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1680 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:06.909066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-d1e75635-0326-44e8-86a4-7905df0ac694 req-01f47a2b-93df-4c6c-bb36-0184feda1368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508fe0c2-63f2-443d-b1a6-594aac42f259", "tag": "afcd99bc-64da-4e1a-855a-3858543e6931"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:06.921486 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d1e75635-0326-44e8-86a4-7905df0ac694 req-01f47a2b-93df-4c6c-bb36-0184feda1368 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:06.922109 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d1e75635-0326-44e8-86a4-7905df0ac694 req-01f47a2b-93df-4c6c-bb36-0184feda1368 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:06.922966 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d1e75635-0326-44e8-86a4-7905df0ac694 req-01f47a2b-93df-4c6c-bb36-0184feda1368 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:06.937135 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-d1e75635-0326-44e8-86a4-7905df0ac694 req-01f47a2b-93df-4c6c-bb36-0184feda1368 service nova] Creating event network-changed:afcd99bc-64da-4e1a-855a-3858543e6931 for instance 508fe0c2-63f2-443d-b1a6-594aac42f259 on hv-cinder-84914 Sep 22 22:17:06.942423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-d1e75635-0326-44e8-86a4-7905df0ac694 req-01f47a2b-93df-4c6c-bb36-0184feda1368 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036974 Sep 22 22:17:06.943058 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 351/680] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:07.354223 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:07.354838 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:07.362100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:07.362581 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:07.363011 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:07.363706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:07.364449 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:07.364875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:07.657322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:07.666892 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2b1e06b9-0b59-4189-9771-0917cd33d461 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1680 microversion: 2.1 time: 0.317459 Sep 22 22:17:07.667476 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 330/681] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:07 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1680 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:08.691606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:08.692645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:08.701151 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:08.701657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:08.702343 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:08.703216 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:08.703829 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:08.704412 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:08.778373 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:08.786952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2723776c-4d67-4e62-9f41-17a97342add2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 200 len: 1613 microversion: 2.1 time: 0.099725 Sep 22 22:17:08.787739 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 352/682] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:08 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 1613 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:08.958802 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-44791788-67bd-40e0-a54d-98402fe2b885 req-4702e410-88b9-46cc-b791-6c85b6c8b9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508fe0c2-63f2-443d-b1a6-594aac42f259", "tag": "afcd99bc-64da-4e1a-855a-3858543e6931"}, {"server_uuid": "60e7432c-e9dc-49c3-a476-991a48adde7c", "name": "network-vif-deleted", "tag": "c3df795b-10a6-4413-9642-8213c6eae0f4"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:08.971663 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-44791788-67bd-40e0-a54d-98402fe2b885 req-4702e410-88b9-46cc-b791-6c85b6c8b9fc service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:08.972439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-44791788-67bd-40e0-a54d-98402fe2b885 req-4702e410-88b9-46cc-b791-6c85b6c8b9fc service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:08.973014 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-44791788-67bd-40e0-a54d-98402fe2b885 req-4702e410-88b9-46cc-b791-6c85b6c8b9fc service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:08.993515 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-44791788-67bd-40e0-a54d-98402fe2b885 req-4702e410-88b9-46cc-b791-6c85b6c8b9fc service nova] Creating event network-changed:afcd99bc-64da-4e1a-855a-3858543e6931 for instance 508fe0c2-63f2-443d-b1a6-594aac42f259 on hv-cinder-84914 Sep 22 22:17:08.994020 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-44791788-67bd-40e0-a54d-98402fe2b885 req-4702e410-88b9-46cc-b791-6c85b6c8b9fc service nova] Creating event network-vif-deleted:c3df795b-10a6-4413-9642-8213c6eae0f4 for instance 60e7432c-e9dc-49c3-a476-991a48adde7c on hv-cinder-84914 Sep 22 22:17:09.001040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-44791788-67bd-40e0-a54d-98402fe2b885 req-4702e410-88b9-46cc-b791-6c85b6c8b9fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046346 Sep 22 22:17:09.001696 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 331/683] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:17:09.813432 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:09.815872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:09.831033 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:09.834549 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:09.835560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:09.836287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:09.836756 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:09.837996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:09.857591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c HTTP/1.1 Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:17:09.859374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:17:09.861030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '60e7432c-e9dc-49c3-a476-991a48adde7c'} Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:17:09.862277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:17:09.863780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:17:09.865894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:17:09.867788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1bf69fcc-f0ac-4cd3-a365-04b0d3b4fb50 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 404 len: 111 microversion: 2.1 time: 0.059488 Sep 22 22:17:09.869507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 353/684] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:09 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:17:09.878101 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ac9292d7-eac6-4183-a1a2-448e171c7379 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '.version_select at 0x7f405cba9e50>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:09.902588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ac9292d7-eac6-4183-a1a2-448e171c7379 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410324415" status: 202 len: 0 microversion: 2.1 time: 0.028524 Sep 22 22:17:09.903809 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 332/685] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 22 22:17:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410324415 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:17:10.653757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:10.654252 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:10.660081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:10.660559 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:10.660993 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:10.661701 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:10.662154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:10.662574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:10.742203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lazy-loading 'services' on Instance uuid 765e0b40-b687-4b25-b264-0b84e9d0a8a3 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:17:10.859422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-41cf3022-4afb-4530-90f4-4eb534be79e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments/49ad5890-b87e-4061-af3b-05c4d050ea04" status: 202 len: 0 microversion: 2.1 time: 0.209244 Sep 22 22:17:10.860189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 354/686] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:17:10 2022] DELETE /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments/49ad5890-b87e-4061-af3b-05c4d050ea04 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:17:10.869676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-498ea544-a6cf-4392-8906-f00e287e4dab tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:10.872718 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-498ea544-a6cf-4392-8906-f00e287e4dab tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:10.881008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-498ea544-a6cf-4392-8906-f00e287e4dab tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:10.881895 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-498ea544-a6cf-4392-8906-f00e287e4dab tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:10.882589 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-498ea544-a6cf-4392-8906-f00e287e4dab tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:10.883276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-498ea544-a6cf-4392-8906-f00e287e4dab tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:10.883726 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-498ea544-a6cf-4392-8906-f00e287e4dab tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:10.884149 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-498ea544-a6cf-4392-8906-f00e287e4dab tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:10.918195 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-498ea544-a6cf-4392-8906-f00e287e4dab tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053718 Sep 22 22:17:10.918775 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 333/687] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:17:10 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:11.931895 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-35b795ea-1f61-48dd-96de-b10f17b72f75 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:11.934207 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-35b795ea-1f61-48dd-96de-b10f17b72f75 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:11.940286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35b795ea-1f61-48dd-96de-b10f17b72f75 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:11.940733 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35b795ea-1f61-48dd-96de-b10f17b72f75 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:11.941183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35b795ea-1f61-48dd-96de-b10f17b72f75 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:11.941863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35b795ea-1f61-48dd-96de-b10f17b72f75 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:11.942309 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35b795ea-1f61-48dd-96de-b10f17b72f75 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:11.942730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35b795ea-1f61-48dd-96de-b10f17b72f75 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:11.972876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-35b795ea-1f61-48dd-96de-b10f17b72f75 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Sep 22 22:17:11.973468 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 355/688] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:17:11 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:12.985846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-83c3156c-4a64-4281-aea7-dda91d20883e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:12.987860 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-83c3156c-4a64-4281-aea7-dda91d20883e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:12.995504 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c3156c-4a64-4281-aea7-dda91d20883e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:12.995996 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c3156c-4a64-4281-aea7-dda91d20883e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:12.996438 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c3156c-4a64-4281-aea7-dda91d20883e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:12.997151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c3156c-4a64-4281-aea7-dda91d20883e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:12.997611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c3156c-4a64-4281-aea7-dda91d20883e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:12.998034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-83c3156c-4a64-4281-aea7-dda91d20883e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:13.028683 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-83c3156c-4a64-4281-aea7-dda91d20883e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047191 Sep 22 22:17:13.029302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 334/689] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:17:12 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 22:17:13.096434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:13.096947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:13.103490 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:13.103973 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:13.104411 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:13.105098 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:13.105610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:13.106036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:13.130795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:17:13.202687 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a07e7e4b-5f07-4784-9f0b-c338356d1f53 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 204 len: 0 microversion: 2.1 time: 0.109957 Sep 22 22:17:13.203270 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 356/690] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:17:13 2022] DELETE /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:17:13.214426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:13.215021 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:13.221005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:13.221523 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:13.221959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:13.222657 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:13.223110 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:13.223569 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:13.364191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:13.372085 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0996858b-abd5-45c3-9e55-14e299c53723 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1684 microversion: 2.1 time: 0.164002 Sep 22 22:17:13.372654 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 335/691] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:13 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:14.396052 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:14.396658 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:14.403881 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:14.404363 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:14.404793 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:14.405517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:14.405965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:14.406382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:14.583765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:14.594926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-555fe544-387b-4dc5-80d0-8b08e9e30328 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1684 microversion: 2.1 time: 0.202903 Sep 22 22:17:14.595776 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 357/692] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:14 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1684 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:15.337483 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-83337cff-bf8b-46cb-ad70-4dea86208759 req-1897f9fb-a22d-4e40-910d-f28e72d35eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765e0b40-b687-4b25-b264-0b84e9d0a8a3", "name": "network-vif-deleted", "tag": "1f73d7aa-997f-4856-81f0-98fb975bdbf8"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:15.346902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:15.352392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-83337cff-bf8b-46cb-ad70-4dea86208759 req-1897f9fb-a22d-4e40-910d-f28e72d35eac service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:15.352877 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-83337cff-bf8b-46cb-ad70-4dea86208759 req-1897f9fb-a22d-4e40-910d-f28e72d35eac service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:15.353318 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-83337cff-bf8b-46cb-ad70-4dea86208759 req-1897f9fb-a22d-4e40-910d-f28e72d35eac service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:15.366195 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-83337cff-bf8b-46cb-ad70-4dea86208759 req-1897f9fb-a22d-4e40-910d-f28e72d35eac service nova] Creating event network-vif-deleted:1f73d7aa-997f-4856-81f0-98fb975bdbf8 for instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 on hv-cinder-84914 Sep 22 22:17:15.372376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-83337cff-bf8b-46cb-ad70-4dea86208759 req-1897f9fb-a22d-4e40-910d-f28e72d35eac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038710 Sep 22 22:17:15.373309 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 336/693] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:15.619514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:15.620120 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:15.626438 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:15.626916 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:15.627346 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:15.628030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:15.628747 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:15.629192 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:15.661952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:15.662467 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:15.662896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:15.663379 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lazy-loading 'fault' on Instance uuid 765e0b40-b687-4b25-b264-0b84e9d0a8a3 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:17:15.712445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:15.720213 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2eca9598-b4ff-4747-a4be-cc407ae573a2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 200 len: 1332 microversion: 2.1 time: 0.105684 Sep 22 22:17:15.720781 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 358/694] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:15 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:16.744537 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:16.745240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:16.752486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:16.752962 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:16.753419 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:16.754096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:16.754544 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:16.754959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:16.768366 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 HTTP/1.1 Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:17:16.769999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:17:16.771585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '765e0b40-b687-4b25-b264-0b84e9d0a8a3'} Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:17:16.772393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:17:16.774461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:17:16.775672 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:17:16.775672 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2cff857d-3659-43a4-9073-4f474ffb3a1b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 404 len: 111 microversion: 2.1 time: 0.031118 Sep 22 22:17:16.775672 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 337/695] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:16 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:17:16.780943 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-289a2355-3e7b-4723-bbf1-b4652048be43 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '.version_select at 0x7f405cbdbee0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:16.799735 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-289a2355-3e7b-4723-bbf1-b4652048be43 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595871874" status: 202 len: 0 microversion: 2.1 time: 0.022552 Sep 22 22:17:16.800289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 359/696] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 22 22:17:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595871874 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:17:17.435123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d4fd16c3-3943-4a65-8e3b-d10b5924c5e7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: .version_select at 0x7f405ca9ba60>, body: {"keypair": {"name": "tempest-keypair-662580538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzPVU+ODsYTz0rsJyzyBdo8RlA8XwjpJcFlWEru9AJYsjDigLG9jpKA991WpFi9RAaEXqzCJlpnq7y4omEyrWM3A7RbuQzdtZdt++ieigwAN0yu9nDCppEC6svtdlBDLw=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:17.450490 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-d4fd16c3-3943-4a65-8e3b-d10b5924c5e7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for project 226257b343d24054bc2178b47a9a5a4f. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:17:17.454215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-d4fd16c3-3943-4a65-8e3b-d10b5924c5e7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for user bcb617f1f41c467fba9717f7f825ac80 and project 226257b343d24054bc2178b47a9a5a4f. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:17:17.478722 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d4fd16c3-3943-4a65-8e3b-d10b5924c5e7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047500 Sep 22 22:17:17.479348 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 338/697] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:17:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:18.726711 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1095249826", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76b70dbd-430e-4822-82a3-49c7f238d2e2"}], "security_groups": [{"name": "tempest-securitygroup--48304948"}], "key_name": "tempest-keypair-662580538", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:18.837961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] validate_networks() for [('76b70dbd-430e-4822-82a3-49c7f238d2e2', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:17:19.780577 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:17:19.781167 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:17:19.781597 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:17:19.782094 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:17:19.782566 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:17:19.791935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:19.792487 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:19.792980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:19.793792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:19.794315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:19.794801 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:19.812215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for project 226257b343d24054bc2178b47a9a5a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:17:19.817348 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for user bcb617f1f41c467fba9717f7f825ac80 and project 226257b343d24054bc2178b47a9a5a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:17:19.829712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:17:19.832025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:17:19.878865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-50d723a6-c9f8-498f-82e3-dbaac4454df0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.156964 Sep 22 22:17:19.879585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 360/698] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:17:18 2022] POST /compute/v2.1/servers => generated 400 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:17:19.891913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e4c3c485-e1b5-4dd8-b9a0-14c257d9062b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:19.892649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e4c3c485-e1b5-4dd8-b9a0-14c257d9062b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:19.954929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e4c3c485-e1b5-4dd8-b9a0-14c257d9062b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:19.963062 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e4c3c485-e1b5-4dd8-b9a0-14c257d9062b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1241 microversion: 2.1 time: 0.075102 Sep 22 22:17:19.963633 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 339/699] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:19 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:20.986538 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:20.987150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:20.993462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:20.993945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:20.994372 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:20.995086 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:20.995535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:20.995951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:21.062103 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:21.070330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-34acb452-df58-4098-8fbe-a58efd49a7cf tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1237 microversion: 2.1 time: 0.087885 Sep 22 22:17:21.070987 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 361/700] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:20 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:17:22.093981 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:22.094590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:22.101398 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:22.101868 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:22.102295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:22.102979 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:22.103427 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:22.103843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:22.176059 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:22.184103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-493fdece-af5a-4821-b7ce-09310d9cef6c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1299 microversion: 2.1 time: 0.094034 Sep 22 22:17:22.184911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 340/701] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:22 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:23.205972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:23.206573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:23.213081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:23.213594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:23.214019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:23.214726 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:23.215174 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:23.215591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:23.230386 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:23.395180 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-ec60e936-5479-45c1-a478-c1e653bccae8 req-9a3c5598-5ca5-49b9-901d-3786bf232b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d604e6-1975-480b-ac89-1fa7caf675f4", "tag": "84508ba9-197d-4731-a7d3-cb48ca241b0d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:23.407133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ec60e936-5479-45c1-a478-c1e653bccae8 req-9a3c5598-5ca5-49b9-901d-3786bf232b91 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:23.407649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ec60e936-5479-45c1-a478-c1e653bccae8 req-9a3c5598-5ca5-49b9-901d-3786bf232b91 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:23.408018 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ec60e936-5479-45c1-a478-c1e653bccae8 req-9a3c5598-5ca5-49b9-901d-3786bf232b91 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:23.421539 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-ec60e936-5479-45c1-a478-c1e653bccae8 req-9a3c5598-5ca5-49b9-901d-3786bf232b91 service nova] Creating event network-changed:84508ba9-197d-4731-a7d3-cb48ca241b0d for instance c0d604e6-1975-480b-ac89-1fa7caf675f4 on hv-cinder-84914 Sep 22 22:17:23.427345 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-ec60e936-5479-45c1-a478-c1e653bccae8 req-9a3c5598-5ca5-49b9-901d-3786bf232b91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037066 Sep 22 22:17:23.428033 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 341/702] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:23.439433 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:23.447185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a4a60f5b-48fb-4ac7-9182-920c0e596182 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1365 microversion: 2.1 time: 0.245028 Sep 22 22:17:23.447753 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 362/703] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:23 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:24.470304 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:24.470996 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:24.477062 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:24.477567 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:24.478007 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:24.478676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:24.479124 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:24.479541 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:24.615434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:24.623465 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2ebad2d8-25fc-4283-a64b-559ffbf0fda0 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1365 microversion: 2.1 time: 0.157816 Sep 22 22:17:24.624034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 342/704] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:24 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:25.646880 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:25.647624 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:25.654025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:25.654506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:25.654939 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:25.655622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:25.656074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:25.656494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:25.782316 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:25.790736 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-51df4c66-4e7e-41b8-a5cd-74cecbd63a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1365 microversion: 2.1 time: 0.147758 Sep 22 22:17:25.791301 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 363/705] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:25 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:26.814479 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:26.815160 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:26.822432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:26.822912 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:26.823348 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:26.824032 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:26.824483 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:26.824907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:26.955148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:26.963621 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-657e6943-f2be-4367-9118-b32be0363037 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1365 microversion: 2.1 time: 0.153190 Sep 22 22:17:26.964185 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 343/706] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:26 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:27.986604 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:27.987185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:27.993959 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:27.994441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:27.994875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:27.995561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:27.996015 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:27.996436 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:28.125379 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:28.133754 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4cda17ad-da40-493f-a823-eb20650322a5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1365 microversion: 2.1 time: 0.151074 Sep 22 22:17:28.134330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 364/707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:27 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:29.157158 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:29.157699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:29.165002 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:29.165503 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:29.165933 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:29.166613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:29.167063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:29.167481 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:29.294996 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:29.302531 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fb462fb7-6587-4e5e-8754-966fbcbb2e5b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1365 microversion: 2.1 time: 0.149319 Sep 22 22:17:29.303155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 344/708] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:29 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:30.325592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:30.326227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:30.328500 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:30.329198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:30.334840 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:30.335322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:30.335754 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:30.336441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:30.336892 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:30.337344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:30.462024 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:30.469514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b19886a6-74c6-4e6a-b295-67a009616a2d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1365 microversion: 2.1 time: 0.147702 Sep 22 22:17:30.470081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 365/709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:30 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:30.880709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-f9396114-7cb1-46b6-98c8-be48d210b0d0 req-d388836f-90b2-4bef-a357-df47e115e516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d604e6-1975-480b-ac89-1fa7caf675f4", "name": "network-vif-plugged", "status": "completed", "tag": "84508ba9-197d-4731-a7d3-cb48ca241b0d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:30.886331 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:30.892596 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f9396114-7cb1-46b6-98c8-be48d210b0d0 req-d388836f-90b2-4bef-a357-df47e115e516 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:30.893071 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f9396114-7cb1-46b6-98c8-be48d210b0d0 req-d388836f-90b2-4bef-a357-df47e115e516 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:30.893521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f9396114-7cb1-46b6-98c8-be48d210b0d0 req-d388836f-90b2-4bef-a357-df47e115e516 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:30.905042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-f9396114-7cb1-46b6-98c8-be48d210b0d0 req-d388836f-90b2-4bef-a357-df47e115e516 service nova] Creating event network-vif-plugged:84508ba9-197d-4731-a7d3-cb48ca241b0d for instance c0d604e6-1975-480b-ac89-1fa7caf675f4 on hv-cinder-84914 Sep 22 22:17:30.909764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-f9396114-7cb1-46b6-98c8-be48d210b0d0 req-d388836f-90b2-4bef-a357-df47e115e516 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Sep 22 22:17:30.910351 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 345/710] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:31.493723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:31.494250 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:31.500522 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:31.500997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:31.501462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:31.502142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:31.502588 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:31.503007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:31.633232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:31.641042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-95df7d83-2c87-4f4a-9e19-2dd3c413ae85 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1365 microversion: 2.1 time: 0.151862 Sep 22 22:17:31.641631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 366/711] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:31 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:32.664989 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:32.665709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:32.671814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:32.672295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:32.672722 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:32.673437 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:32.673884 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:32.674299 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:32.676855 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:32.811980 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:32.820390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b948df09-ecd9-40d3-a144-57a8f45a3b41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1365 microversion: 2.1 time: 0.160995 Sep 22 22:17:32.820957 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 346/712] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:32 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:33.842825 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:33.843458 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:33.845801 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:33.852416 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:33.852939 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:33.853404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:33.854095 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:33.854574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:33.854996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:33.983251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:33.990794 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11b56851-485b-4c89-9353-77bfe524be6d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1555 microversion: 2.1 time: 0.151832 Sep 22 22:17:33.991405 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 367/713] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:33 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:34.013382 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ec466697-e79f-425a-bea5-257103f88496 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:34.013855 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ec466697-e79f-425a-bea5-257103f88496 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:34.020265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec466697-e79f-425a-bea5-257103f88496 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:34.020740 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec466697-e79f-425a-bea5-257103f88496 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:34.021196 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec466697-e79f-425a-bea5-257103f88496 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:34.021870 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec466697-e79f-425a-bea5-257103f88496 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:34.022319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec466697-e79f-425a-bea5-257103f88496 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:34.023404 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ec466697-e79f-425a-bea5-257103f88496 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:34.100906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ec466697-e79f-425a-bea5-257103f88496 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091373 Sep 22 22:17:34.101535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 347/714] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 22 22:17:34 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:35.245043 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-af89c4a4-020d-4888-8505-0606dee146bc req-06f17ee7-66f2-421c-a37b-376bb535e0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d604e6-1975-480b-ac89-1fa7caf675f4", "tag": "84508ba9-197d-4731-a7d3-cb48ca241b0d"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:35.254872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-af89c4a4-020d-4888-8505-0606dee146bc req-06f17ee7-66f2-421c-a37b-376bb535e0ec service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:35.255425 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-af89c4a4-020d-4888-8505-0606dee146bc req-06f17ee7-66f2-421c-a37b-376bb535e0ec service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:35.255929 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-af89c4a4-020d-4888-8505-0606dee146bc req-06f17ee7-66f2-421c-a37b-376bb535e0ec service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:35.269023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-af89c4a4-020d-4888-8505-0606dee146bc req-06f17ee7-66f2-421c-a37b-376bb535e0ec service nova] Creating event network-changed:84508ba9-197d-4731-a7d3-cb48ca241b0d for instance c0d604e6-1975-480b-ac89-1fa7caf675f4 on hv-cinder-84914 Sep 22 22:17:35.275010 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-af89c4a4-020d-4888-8505-0606dee146bc req-06f17ee7-66f2-421c-a37b-376bb535e0ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033839 Sep 22 22:17:35.275641 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 368/715] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:17:39.514618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:39.515104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:39.521007 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:39.521535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:39.522483 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:39.523470 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:39.523933 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:39.524361 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:39.604818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lazy-loading 'services' on Instance uuid fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:17:39.674814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-aa34ec95-67ca-4833-a6dd-6545923a7ed4 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/os-volume_attachments/018f6974-bf82-49a7-9599-0892c39fc97c" status: 202 len: 0 microversion: 2.1 time: 0.262347 Sep 22 22:17:39.675384 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 348/716] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:17:39 2022] DELETE /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/os-volume_attachments/018f6974-bf82-49a7-9599-0892c39fc97c => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:17:40.811177 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3c0ac6fe-42ad-4ea2-9f35-0404400559fc tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:40.817573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c0ac6fe-42ad-4ea2-9f35-0404400559fc tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:40.818218 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c0ac6fe-42ad-4ea2-9f35-0404400559fc tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:40.818735 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3c0ac6fe-42ad-4ea2-9f35-0404400559fc tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:40.877490 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3c0ac6fe-42ad-4ea2-9f35-0404400559fc tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Going to try to stop instance {{(pid=120663) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 22 22:17:40.919346 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3c0ac6fe-42ad-4ea2-9f35-0404400559fc tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/action" status: 202 len: 0 microversion: 2.1 time: 0.112851 Sep 22 22:17:40.919866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 369/717] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:17:40 2022] POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:17:40.929804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:40.930497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:40.936651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:40.937257 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:40.937600 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:40.938352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:40.938996 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:40.939441 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:41.077242 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:41.085541 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0f2dffd5-16f1-4ece-bf5e-0f6652513918 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1678 microversion: 2.1 time: 0.161037 Sep 22 22:17:41.086109 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 349/718] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:40 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:42.111613 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:42.112325 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:42.119048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:42.119528 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:42.119956 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:42.120635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:42.121083 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:42.121554 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:42.249252 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:42.257040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d3f61b5e-2e0c-4ced-8a16-d03b54a87eaf tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1678 microversion: 2.1 time: 0.150108 Sep 22 22:17:42.257627 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 370/719] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:42 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:43.279650 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:43.280246 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:43.286595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:43.287098 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:43.287571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:43.288335 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:43.289034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:43.289481 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:43.415335 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:43.422874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5adb6487-50ef-4271-932b-84621230a968 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1678 microversion: 2.1 time: 0.147043 Sep 22 22:17:43.423435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 350/720] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:43 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:44.447077 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:44.447596 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:44.453645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:44.454123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:44.454555 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:44.455232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:44.455679 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:44.456096 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:44.585146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:44.592749 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd92785e-33ea-4627-9c16-a41507886fd3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1678 microversion: 2.1 time: 0.150267 Sep 22 22:17:44.593346 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 371/721] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:44 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:45.615887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:45.616488 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:45.622944 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:45.623423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:45.623851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:45.624531 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:45.624985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:45.625434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:45.750515 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:45.758390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-95c3af50-6230-4965-810e-685a6bc43244 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1678 microversion: 2.1 time: 0.146494 Sep 22 22:17:45.758958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 351/722] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:45 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:46.782144 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:46.782754 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:46.790168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:46.790646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:46.791074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:46.791756 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:46.792205 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:46.792624 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:46.924870 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:46.933353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5ce3c7a4-fcb8-4293-b36e-a1a2d812140e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1678 microversion: 2.1 time: 0.154981 Sep 22 22:17:46.933925 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 372/723] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:46 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:17:47.956490 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:47.957131 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:47.960434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:17:47.966662 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:47.967147 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:47.967574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:47.968257 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:47.968706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:47.969140 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:48.096953 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:48.105220 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6a8ef47b-ae56-41ee-85cd-e7f4c1d4c44a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1678 microversion: 2.1 time: 0.152558 Sep 22 22:17:48.105783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 352/724] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:47 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:49.128290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:49.128891 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:49.135461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:49.135936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:49.136363 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:49.137042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:49.137516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:49.137933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:49.270155 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:49.278664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-98362d30-d434-45f0-aee0-ab5b5ef20f44 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1678 microversion: 2.1 time: 0.154162 Sep 22 22:17:49.279237 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 373/725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:49 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:50.303267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:50.303866 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:50.310285 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:50.310707 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:50.311133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:50.311813 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:50.312260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:50.312675 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:50.441372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:50.449151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-35848a6d-2b07-4558-91b5-a41b4504022b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1678 microversion: 2.1 time: 0.150196 Sep 22 22:17:50.449723 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 353/726] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:50 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:51.472057 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:51.472597 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:51.479238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:51.479717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:51.480153 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:51.480822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:51.481308 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:51.481731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:51.606936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:51.614493 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-91cca546-4baf-4115-89ab-815f12e5f56c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1655 microversion: 2.1 time: 0.146431 Sep 22 22:17:51.615613 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 374/727] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:51 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:51.638291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-77cfb17c-499b-4eeb-be8b-e29a41827ce0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:17:51.644745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77cfb17c-499b-4eeb-be8b-e29a41827ce0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:51.645271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77cfb17c-499b-4eeb-be8b-e29a41827ce0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:51.645713 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-77cfb17c-499b-4eeb-be8b-e29a41827ce0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:51.667415 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-77cfb17c-499b-4eeb-be8b-e29a41827ce0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Going to try to start instance {{(pid=120662) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 22 22:17:51.708164 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-77cfb17c-499b-4eeb-be8b-e29a41827ce0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/action" status: 202 len: 0 microversion: 2.1 time: 0.073673 Sep 22 22:17:51.708913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 354/728] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:17:51 2022] POST /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 22:17:51.716996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:51.717631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:51.723702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:51.723995 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:51.724570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:51.725311 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:51.725767 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:51.726189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:51.892570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:51.901199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c337a7ec-d336-4c37-81b3-981d9faee44e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1664 microversion: 2.1 time: 0.187999 Sep 22 22:17:51.902087 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 375/729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:51 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1664 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:17:52.924709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:17:52.925420 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:17:52.931682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:52.932168 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:52.932604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:52.933331 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:17:52.933870 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:17:52.934297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:17:53.067044 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:17:53.075695 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-611afcaf-17c6-4061-9d5e-a8e71df9ccff tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1668 microversion: 2.1 time: 0.155625 Sep 22 22:17:53.076261 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 355/730] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:17:52 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:02.652689 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b2e68340-b218-4a58-b57f-b3a0fc52c3ff tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:02.654947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b2e68340-b218-4a58-b57f-b3a0fc52c3ff tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:02.657576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=17 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:02.658238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:02.665091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2e68340-b218-4a58-b57f-b3a0fc52c3ff tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:02.665598 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2e68340-b218-4a58-b57f-b3a0fc52c3ff tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:02.666033 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2e68340-b218-4a58-b57f-b3a0fc52c3ff tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:02.666723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2e68340-b218-4a58-b57f-b3a0fc52c3ff tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:02.667176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2e68340-b218-4a58-b57f-b3a0fc52c3ff tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:02.667596 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2e68340-b218-4a58-b57f-b3a0fc52c3ff tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:02.741409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b2e68340-b218-4a58-b57f-b3a0fc52c3ff tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "POST /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/action" status: 202 len: 0 microversion: 2.1 time: 0.092610 Sep 22 22:18:02.742032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 376/731] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:18:02 2022] POST /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:18:02.750586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:02.751955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:02.759632 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:02.760126 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:02.760565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:02.761354 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:02.761958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:02.762389 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:02.766963 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:02.803800 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:02.804387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:02.810798 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:02.811299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:02.811740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:02.812444 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:02.812898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:02.813360 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:02.904612 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lazy-loading 'services' on Instance uuid 508fe0c2-63f2-443d-b1a6-594aac42f259 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:18:02.977463 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:02.977618 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c664e385-5889-4d3f-b09d-d379a39301ea tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "DELETE /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments/ab8c7488-2cf4-45df-af73-208ab10a1ba7" status: 202 len: 0 microversion: 2.1 time: 0.178337 Sep 22 22:18:02.978498 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 377/732] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:18:02 2022] DELETE /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments/ab8c7488-2cf4-45df-af73-208ab10a1ba7 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 22:18:02.987794 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b20f4545-312d-4319-a107-e914ef2cfb7c tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1750 microversion: 2.1 time: 0.240904 Sep 22 22:18:02.988757 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 356/733] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:02 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1750 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:02.997016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4938e49e-5a77-4810-ac47-016837ba63a2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:02.999410 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4938e49e-5a77-4810-ac47-016837ba63a2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:03.011614 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4938e49e-5a77-4810-ac47-016837ba63a2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:03.012341 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4938e49e-5a77-4810-ac47-016837ba63a2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:03.012833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4938e49e-5a77-4810-ac47-016837ba63a2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:03.013681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4938e49e-5a77-4810-ac47-016837ba63a2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:03.014002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4938e49e-5a77-4810-ac47-016837ba63a2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:03.014419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4938e49e-5a77-4810-ac47-016837ba63a2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:03.047114 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4938e49e-5a77-4810-ac47-016837ba63a2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064020 Sep 22 22:18:03.047680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 378/734] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:18:02 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:04.015602 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:04.016206 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:04.022586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:04.023063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:04.023492 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:04.024170 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:04.024619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:04.025034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:04.061081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3ee06442-b31c-4059-8055-8160edd7d46c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:04.063778 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3ee06442-b31c-4059-8055-8160edd7d46c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:04.070662 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ee06442-b31c-4059-8055-8160edd7d46c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:04.071152 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ee06442-b31c-4059-8055-8160edd7d46c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:04.071719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ee06442-b31c-4059-8055-8160edd7d46c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:04.072422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ee06442-b31c-4059-8055-8160edd7d46c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:04.073883 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ee06442-b31c-4059-8055-8160edd7d46c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:04.074318 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ee06442-b31c-4059-8055-8160edd7d46c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:04.111197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3ee06442-b31c-4059-8055-8160edd7d46c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054397 Sep 22 22:18:04.112192 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 379/735] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:18:04 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:04.180770 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:04.188905 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-32a50c25-fcb4-4a56-add5-687b02688558 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1750 microversion: 2.1 time: 0.177079 Sep 22 22:18:04.189517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 357/736] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:04 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:05.124344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-30333213-570c-4610-87b3-17c3c44985e3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:05.126589 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-30333213-570c-4610-87b3-17c3c44985e3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:05.133836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30333213-570c-4610-87b3-17c3c44985e3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:05.134327 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30333213-570c-4610-87b3-17c3c44985e3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:05.134762 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30333213-570c-4610-87b3-17c3c44985e3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:05.135458 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30333213-570c-4610-87b3-17c3c44985e3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:05.135909 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30333213-570c-4610-87b3-17c3c44985e3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:05.136328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-30333213-570c-4610-87b3-17c3c44985e3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:05.165564 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-30333213-570c-4610-87b3-17c3c44985e3 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045167 Sep 22 22:18:05.166123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 380/737] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:18:05 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 22:18:05.212392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:05.213041 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:05.219321 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:05.219804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:05.220243 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:05.220933 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:05.221429 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:05.221853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:05.242588 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:05.243079 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:05.248965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:05.249473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:05.249905 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:05.250590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:05.251038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:05.251454 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:05.276796 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:18:05.353579 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8f12d994-0107-4026-a335-134981e8cd34 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "DELETE /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 204 len: 0 microversion: 2.1 time: 0.115001 Sep 22 22:18:05.354422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 381/738] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:18:05 2022] DELETE /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 22:18:05.362827 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:05.363773 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:05.370510 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:05.371006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:05.371448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:05.371812 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:05.372154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:05.372610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:05.373021 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:05.380353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b46887ab-808e-4544-9a01-c986951a53e7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1755 microversion: 2.1 time: 0.171912 Sep 22 22:18:05.380998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 358/739] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:05 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:05.504987 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:05.512764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-48424f10-d585-4d70-b996-40b5bff2bf9b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1689 microversion: 2.1 time: 0.154216 Sep 22 22:18:05.513477 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 382/740] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:05 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:06.404712 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:06.405302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:06.412050 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:06.412808 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:06.413246 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:06.413942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:06.414394 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:06.414815 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:06.536395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:06.537122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:06.543600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:06.544081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:06.544512 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:06.545251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:06.545702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:06.546118 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:06.558556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:06.566656 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-375cfd5f-fcfe-47cc-a7db-1cc18541b27e tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1755 microversion: 2.1 time: 0.165846 Sep 22 22:18:06.567887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 359/741] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:06 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:06.673197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:06.681375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4bb14591-908c-4b34-a434-b2c514e6c51c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1689 microversion: 2.1 time: 0.148962 Sep 22 22:18:06.681939 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 383/742] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:06 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:18:07.590989 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:07.591625 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:07.597928 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:07.598982 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:07.599514 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:07.600190 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:07.600640 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:07.601057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:07.705367 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:07.705993 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:07.713042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:07.713552 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:07.713988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:07.714670 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:07.715150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:07.715573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:07.749656 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:07.758874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-341ce7c6-3fc5-43e7-b134-be8cbd844efd tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1755 microversion: 2.1 time: 0.171700 Sep 22 22:18:07.759651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 360/743] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:07 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:07.844795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:07.852441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6e97b6cf-64b0-4e91-857d-d4e1cb4bc64d tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1689 microversion: 2.1 time: 0.151012 Sep 22 22:18:07.853005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 384/744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:07 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:18:08.783613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:08.784198 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:08.791219 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:08.791719 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:08.792135 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:08.792843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:08.793322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:08.793746 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:08.875767 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:08.876380 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:08.882669 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:08.883152 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:08.883589 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:08.884281 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:08.884731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:08.885201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:08.975331 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:08.984008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2a9fa565-2169-4243-bea5-2b7608b00500 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1755 microversion: 2.1 time: 0.204387 Sep 22 22:18:08.984606 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 361/745] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:08 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:09.038008 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:09.046215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fd6fa568-6c4c-4a37-890b-0b129c7fe360 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1689 microversion: 2.1 time: 0.174323 Sep 22 22:18:09.046818 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 385/746] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:08 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:18:10.009002 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:10.010410 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:10.017297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:10.017793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:10.018235 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:10.018946 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:10.019403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:10.019832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:10.070245 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:10.072078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:10.079352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:10.080079 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:10.080530 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:10.081287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:10.081884 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:10.082314 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:10.295454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:10.304914 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-be492edb-3801-4a2a-8c7b-88e64e4aefdf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1755 microversion: 2.1 time: 0.300324 Sep 22 22:18:10.305626 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 362/747] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:10 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1755 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:10.349604 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:10.358822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9cdea73b-2795-4d8a-b359-16365ec9835f tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1689 microversion: 2.1 time: 0.293100 Sep 22 22:18:10.360122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 386/748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:10 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1689 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:18:10.622926 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-fe60cb45-9227-4d83-a806-f4c4b81dd803 req-9f6363a4-5aa6-437b-a8c0-03e2adcaeddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508fe0c2-63f2-443d-b1a6-594aac42f259", "name": "network-vif-deleted", "tag": "afcd99bc-64da-4e1a-855a-3858543e6931"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:10.632293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fe60cb45-9227-4d83-a806-f4c4b81dd803 req-9f6363a4-5aa6-437b-a8c0-03e2adcaeddd service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:10.632862 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fe60cb45-9227-4d83-a806-f4c4b81dd803 req-9f6363a4-5aa6-437b-a8c0-03e2adcaeddd service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:10.633356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-fe60cb45-9227-4d83-a806-f4c4b81dd803 req-9f6363a4-5aa6-437b-a8c0-03e2adcaeddd service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:10.645686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-fe60cb45-9227-4d83-a806-f4c4b81dd803 req-9f6363a4-5aa6-437b-a8c0-03e2adcaeddd service nova] Creating event network-vif-deleted:afcd99bc-64da-4e1a-855a-3858543e6931 for instance 508fe0c2-63f2-443d-b1a6-594aac42f259 on hv-cinder-84914 Sep 22 22:18:10.652967 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-fe60cb45-9227-4d83-a806-f4c4b81dd803 req-9f6363a4-5aa6-437b-a8c0-03e2adcaeddd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033054 Sep 22 22:18:10.654385 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 363/749] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:11.327943 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:11.328457 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:11.335712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:11.336207 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:11.336680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:11.337481 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:11.337935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:11.338365 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:11.385065 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:11.385794 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:11.392611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:11.393126 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:11.393749 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:11.394466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:11.394921 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:11.395346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:11.434225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:11.434714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:11.435149 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:11.435597 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lazy-loading 'fault' on Instance uuid 508fe0c2-63f2-443d-b1a6-594aac42f259 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:18:11.719901 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:11.729119 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d8dacbc5-d813-4e74-bd39-284a05270334 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 200 len: 1335 microversion: 2.1 time: 0.350160 Sep 22 22:18:11.744666 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 364/750] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:11 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 1335 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:11.755371 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:11.763476 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f1f538f9-c3b8-44b1-95c3-aa0c3cec68b7 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1755 microversion: 2.1 time: 0.439502 Sep 22 22:18:11.764719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 387/751] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:11 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1755 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:12.752392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:12.752958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 508fe0c2-63f2-443d-b1a6-594aac42f259] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:12.759949 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:12.760428 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:12.760864 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:12.761582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:12.762037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:12.762457 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:12.776132 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] HTTP exception thrown: Instance 508fe0c2-63f2-443d-b1a6-594aac42f259 could not be found. Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Request method failure captured: Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 HTTP/1.1 Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1MwaNckOyBXrl2li1Wzti5__EIIu_hQ71URQjXNxaSZLgxsPx47PdZhEErbdvvOH1NrgTqx4PXvZ3GkkpZIv1qXRWw76GInH6xlbrSFAXJ957yGl9VLt68K55_b1yCGudQh9z-LJZ0LUKJIFYiuxgvsttGS5_gwxD9er05GWlixn4 Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:18:12.777842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0499a794df4444b594ee3126a8e210c1", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: ca01fc46c837486b808390ff0c48fa1f Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 508fe0c2-63f2-443d-b1a6-594aac42f259 could not be found. Sep 22 22:18:12.779439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '508fe0c2-63f2-443d-b1a6-594aac42f259'} Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 508fe0c2-63f2-443d-b1a6-594aac42f259 could not be found. Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:18:12.780346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 508fe0c2-63f2-443d-b1a6-594aac42f259 could not be found. Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 508fe0c2-63f2-443d-b1a6-594aac42f259 could not be found. Sep 22 22:18:12.781945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:12.783324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Returning 404 to user: Instance 508fe0c2-63f2-443d-b1a6-594aac42f259 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:18:12.783324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2b385cf4-9bd2-4b36-b423-e7b5a0d95f0b tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259" status: 404 len: 111 microversion: 2.1 time: 0.030760 Sep 22 22:18:12.783324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 365/752] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:12 2022] GET /compute/v2.1/servers/508fe0c2-63f2-443d-b1a6-594aac42f259 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:18:12.789246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4e40f8f3-b62d-43cd-b6ce-ff6118b7a660 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '.version_select at 0x7f405c9bddc0>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:12.789854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:12.790466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:12.796255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:12.796725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:12.797210 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:12.797893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:12.798344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:12.798760 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:12.808064 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4e40f8f3-b62d-43cd-b6ce-ff6118b7a660 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772039435" status: 202 len: 0 microversion: 2.1 time: 0.023715 Sep 22 22:18:12.808677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 388/753] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 22 22:18:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772039435 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:18:13.013018 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:13.021253 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-722ca0af-bdf8-472a-a538-44215e727099 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1755 microversion: 2.1 time: 0.236012 Sep 22 22:18:13.021824 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 366/754] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:12 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1755 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:18:14.047227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:14.047968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:14.057537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:14.058022 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:14.058651 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:14.059126 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:14.059573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:14.059990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:14.199775 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:14.207770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ec92376a-4a1b-40dc-b145-8c4130a8b20f tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1755 microversion: 2.1 time: 0.165060 Sep 22 22:18:14.208326 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 389/755] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:14 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:15.230943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:15.231503 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:15.238055 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:15.238534 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:15.238962 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:15.239646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:15.240093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:15.240525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:15.383754 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:15.391751 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-efa188c6-2219-4330-a64b-54ce5deca2d9 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1758 microversion: 2.1 time: 0.164781 Sep 22 22:18:15.392310 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 367/756] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:15 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:15.752610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:15.753147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:15.760587 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:15.761066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:15.761529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:15.762208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:15.762662 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:15.763082 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:15.767121 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:15.789570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:18:15.868115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e4d3e4b1-4620-450d-8fc2-0e4b33e787a5 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 204 len: 0 microversion: 2.1 time: 0.119021 Sep 22 22:18:15.868796 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 390/757] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:18:15 2022] DELETE /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:18:15.877073 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:15.877706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:15.883651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:15.884120 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:15.884549 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:15.885268 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:15.885719 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:15.886143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:16.013345 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:16.020914 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-954b6c9b-5aab-4508-b3be-b0495aa4a499 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1507 microversion: 2.1 time: 0.147569 Sep 22 22:18:16.021502 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 368/758] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:15 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:17.046211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:17.047684 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:17.054514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:17.054999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:17.055430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:17.056883 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:17.057479 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:17.057803 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:17.260888 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:17.268878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9eda1686-d3d4-4bc8-b215-863ee155e7f7 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 200 len: 1507 microversion: 2.1 time: 0.227977 Sep 22 22:18:17.269564 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 391/759] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:17 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:17.470887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-4dfbe0cd-f36d-418e-89f9-087c6294dcbc req-6a2b61d1-00cc-4332-ab4f-f207e5aa5396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4", "name": "network-vif-deleted", "tag": "9fd347ea-72b4-4b9b-97b6-c703e8d2774a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:17.487143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4dfbe0cd-f36d-418e-89f9-087c6294dcbc req-6a2b61d1-00cc-4332-ab4f-f207e5aa5396 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:17.487627 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4dfbe0cd-f36d-418e-89f9-087c6294dcbc req-6a2b61d1-00cc-4332-ab4f-f207e5aa5396 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:17.488072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4dfbe0cd-f36d-418e-89f9-087c6294dcbc req-6a2b61d1-00cc-4332-ab4f-f207e5aa5396 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:17.499755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-4dfbe0cd-f36d-418e-89f9-087c6294dcbc req-6a2b61d1-00cc-4332-ab4f-f207e5aa5396 service nova] Creating event network-vif-deleted:9fd347ea-72b4-4b9b-97b6-c703e8d2774a for instance e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 on hv-cinder-84914 Sep 22 22:18:17.505224 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-4dfbe0cd-f36d-418e-89f9-087c6294dcbc req-6a2b61d1-00cc-4332-ab4f-f207e5aa5396 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038055 Sep 22 22:18:17.506476 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 369/760] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:18:18.292035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:18.292663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:18.299095 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:18.299592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:18.300065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:18.300755 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:18.301261 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:18.301686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:18.314964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] HTTP exception thrown: Instance e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 could not be found. Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Request method failure captured: Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 HTTP/1.1 Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1MwaNckOyBXrl2li1Wzti5__EIIu_hQ71URQjXNxaSZLgxsPx47PdZhEErbdvvOH1NrgTqx4PXvZ3GkkpZIv1qXRWw76GInH6xlbrSFAXJ957yGl9VLt68K55_b1yCGudQh9z-LJZ0LUKJIFYiuxgvsttGS5_gwxD9er05GWlixn4 Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:18:18.316513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0499a794df4444b594ee3126a8e210c1", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: ca01fc46c837486b808390ff0c48fa1f Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 could not be found. Sep 22 22:18:18.318283 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4'} Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 could not be found. Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:18:18.319185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 could not be found. Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 could not be found. Sep 22 22:18:18.321211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:18.322642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Returning 404 to user: Instance e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:18:18.322642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2385ee12-9a0e-4c76-a5a2-a77a50edc428 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4" status: 404 len: 111 microversion: 2.1 time: 0.029855 Sep 22 22:18:18.322642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 392/761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:18 2022] GET /compute/v2.1/servers/e39a6c4e-e0c0-4099-bc85-a029e2bcf1b4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:18:18.327765 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:18.328389 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:18.330324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=38 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:18.336801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:18.337511 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:18.337953 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:18.338739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:18.339217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:18.339691 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:18.365284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:18:18.439927 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9c8b0ceb-42a0-47e0-80ad-7a9ef1db21d2 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "DELETE /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 204 len: 0 microversion: 2.1 time: 0.116068 Sep 22 22:18:18.440512 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 370/762] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:18:18 2022] DELETE /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:18:18.450195 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:18.450806 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:18.456798 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:18.457324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:18.457764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:18.458487 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:18.458947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:18.459376 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:18.593843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:18.602079 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ef243d63-0614-4c00-9879-ffccc2e10370 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.156413 Sep 22 22:18:18.602659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 393/763] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:18 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:19.626403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:19.627110 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:19.634095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:19.634591 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:19.635029 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:19.635735 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:19.636191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:19.636619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:19.943954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:19.952893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cd3cabec-c928-4a94-9de2-133da617d181 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1522 microversion: 2.1 time: 0.330699 Sep 22 22:18:19.953498 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 371/764] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:19 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:20.231532 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-9ef2aaca-ad6d-4363-aa1f-45387df5fa38 req-8fd1b2b8-d011-4fc9-9146-7e9db485cb33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b462de-3ef3-4c76-bf6c-f1ce9edcda5b", "name": "network-vif-deleted", "tag": "8663b072-db48-4fbd-b30f-98d4794fd966"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:20.241838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9ef2aaca-ad6d-4363-aa1f-45387df5fa38 req-8fd1b2b8-d011-4fc9-9146-7e9db485cb33 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:20.242315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9ef2aaca-ad6d-4363-aa1f-45387df5fa38 req-8fd1b2b8-d011-4fc9-9146-7e9db485cb33 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:20.242734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9ef2aaca-ad6d-4363-aa1f-45387df5fa38 req-8fd1b2b8-d011-4fc9-9146-7e9db485cb33 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:20.253456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-9ef2aaca-ad6d-4363-aa1f-45387df5fa38 req-8fd1b2b8-d011-4fc9-9146-7e9db485cb33 service nova] Creating event network-vif-deleted:8663b072-db48-4fbd-b30f-98d4794fd966 for instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b on hv-cinder-84914 Sep 22 22:18:20.258983 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-9ef2aaca-ad6d-4363-aa1f-45387df5fa38 req-8fd1b2b8-d011-4fc9-9146-7e9db485cb33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031050 Sep 22 22:18:20.259552 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 394/765] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:20.976582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:20.977261 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:20.983881 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:20.984368 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:20.984804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:20.985535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:20.985993 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:20.986447 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:21.017745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:21.018228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:21.018668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:21.019133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lazy-loading 'fault' on Instance uuid 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:18:21.021990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:21.064917 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01fc46c837486b808390ff0c48fa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0499a794df4444b594ee3126a8e210c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:21.073696 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a5abc14e-e517-48cb-90d7-a2919f3a7e74 tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 200 len: 1312 microversion: 2.1 time: 0.101768 Sep 22 22:18:21.074247 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 372/766] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:20 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:22.098208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:22.098898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] [instance: 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:22.105738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:22.106222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:22.106652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:22.107329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:22.107780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:22.108226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:22.121862 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] HTTP exception thrown: Instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b could not be found. Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Request method failure captured: Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b HTTP/1.1 Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1MwaNckOyBXrl2li1Wzti5__EIIu_hQ71URQjXNxaSZLgxsPx47PdZhEErbdvvOH1NrgTqx4PXvZ3GkkpZIv1qXRWw76GInH6xlbrSFAXJ957yGl9VLt68K55_b1yCGudQh9z-LJZ0LUKJIFYiuxgvsttGS5_gwxD9er05GWlixn4 Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:18:22.123434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0499a794df4444b594ee3126a8e210c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0499a794df4444b594ee3126a8e210c1", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 0499a794df4444b594ee3126a8e210c1 Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2124807442 Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: ca01fc46c837486b808390ff0c48fa1f Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2124807442-project Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b could not be found. Sep 22 22:18:22.125025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '16b462de-3ef3-4c76-bf6c-f1ce9edcda5b'} Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b could not be found. Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:18:22.125986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b could not be found. Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b could not be found. Sep 22 22:18:22.127456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:18:22.128753 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] Returning 404 to user: Instance 16b462de-3ef3-4c76-bf6c-f1ce9edcda5b could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:18:22.128753 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e5cce47d-5e3b-4ef4-85cf-c092b2393d8c tempest-ServerRescueNegativeTestJSON-2124807442 tempest-ServerRescueNegativeTestJSON-2124807442-project] 10.222.0.25 "GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b" status: 404 len: 111 microversion: 2.1 time: 0.031302 Sep 22 22:18:22.128753 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 395/767] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:22 2022] GET /compute/v2.1/servers/16b462de-3ef3-4c76-bf6c-f1ce9edcda5b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:18:30.699268 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-862b1fec-d4da-4f1b-ae27-d12e416c01c0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'create', calling method: .version_select at 0x7f405ca9bee0>, body: {"keypair": {"name": "tempest-keypair-1946503403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDts6dFwzQfHv5Ohql2o8Zx3tWLBVGt4Hg/2J9MSgtCc0sGPCnEelPjCsLWS0yZ7rUbZWA5FlGZazE7cEPmVhwtbt9wUkOI124tQmENB5+In2oqN+iLpQMmbPxJU5j5BQ=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:30.715623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-862b1fec-d4da-4f1b-ae27-d12e416c01c0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Getting quotas for project eaff29c3c9b84929b0451e8e82caf4f2. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:18:30.719554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-862b1fec-d4da-4f1b-ae27-d12e416c01c0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Getting quotas for user 1b01f21ffa814a5da3873e5387938b2a and project eaff29c3c9b84929b0451e8e82caf4f2. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:18:30.744428 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-862b1fec-d4da-4f1b-ae27-d12e416c01c0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.211711 Sep 22 22:18:30.745035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 373/768] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Sep 22 22:18:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 22 22:18:32.060838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1836826501", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3032908-0d20-4083-a609-def5ad9a09dd"}], "security_groups": [{"name": "tempest-securitygroup--351913687"}], "key_name": "tempest-keypair-1946503403", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:32.113134 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:32.173466 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] validate_networks() for [('a3032908-0d20-4083-a609-def5ad9a09dd', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:18:32.277226 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:32.281556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:32.282049 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:32.289760 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:32.290255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:32.290690 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:32.291395 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:32.292066 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:32.292492 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:32.319856 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:18:32.404015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e73efc39-349d-4e01-ae98-590d3fb783c8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 204 len: 0 microversion: 2.1 time: 0.127088 Sep 22 22:18:32.404809 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 374/769] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:18:32 2022] DELETE /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 22:18:32.415268 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:32.416561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:32.423480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:32.424124 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:32.424843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:32.425954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:32.426744 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:32.427358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:32.622041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:18:32.622555 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:18:32.623105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:18:32.623737 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:18:32.624171 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:18:32.634584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:32.635080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:32.635519 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:32.636258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:32.636771 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:32.637178 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:32.640398 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:32.649657 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f6725f7b-b7c8-4e82-9ee8-2c204ce6504b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1576 microversion: 2.1 time: 0.240228 Sep 22 22:18:32.650358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 375/770] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:32 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:18:32.656653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Getting quotas for project eaff29c3c9b84929b0451e8e82caf4f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:18:32.661044 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Getting quotas for user 1b01f21ffa814a5da3873e5387938b2a and project eaff29c3c9b84929b0451e8e82caf4f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:18:32.664085 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:32.676201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:18:32.679501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:18:32.738699 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2455989d-5542-48da-bf28-2697f16dd14e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.684791 Sep 22 22:18:32.740962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 396/771] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Sep 22 22:18:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 22 22:18:32.752375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-39e80d2e-0940-4250-a53b-77c02a920d43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:32.753077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-39e80d2e-0940-4250-a53b-77c02a920d43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:32.807122 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-39e80d2e-0940-4250-a53b-77c02a920d43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:32.814613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-39e80d2e-0940-4250-a53b-77c02a920d43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:32.816140 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-39e80d2e-0940-4250-a53b-77c02a920d43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:32.817284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-39e80d2e-0940-4250-a53b-77c02a920d43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1282 microversion: 2.20 time: 0.069180 Sep 22 22:18:32.817847 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 376/772] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:32 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:33.674570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:33.675181 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:33.684446 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:33.684931 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:33.685610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:33.686097 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:33.686548 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:33.687002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:33.842913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9653ed21-515f-47f0-812f-9dd3e0c147d3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:33.843859 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9653ed21-515f-47f0-812f-9dd3e0c147d3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:33.855937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:33.873525 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-230617c3-b010-49ae-b3e9-bfd2196e6110 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1576 microversion: 2.1 time: 0.203182 Sep 22 22:18:33.890219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 397/773] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:33 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:33.926411 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9653ed21-515f-47f0-812f-9dd3e0c147d3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:33.935315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9653ed21-515f-47f0-812f-9dd3e0c147d3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:33.936772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9653ed21-515f-47f0-812f-9dd3e0c147d3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:33.938151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9653ed21-515f-47f0-812f-9dd3e0c147d3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1282 microversion: 2.20 time: 0.099025 Sep 22 22:18:33.938711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 377/774] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:33 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:18:34.903641 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:34.904169 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:34.911956 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:34.912341 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:34.912802 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:34.913532 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:34.913982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:34.914397 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:34.964057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c580648b-42aa-4d10-ac36-6af2d781dc9d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:34.965318 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c580648b-42aa-4d10-ac36-6af2d781dc9d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:35.047051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c580648b-42aa-4d10-ac36-6af2d781dc9d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:35.055120 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c580648b-42aa-4d10-ac36-6af2d781dc9d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:35.056746 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c580648b-42aa-4d10-ac36-6af2d781dc9d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:35.058145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c580648b-42aa-4d10-ac36-6af2d781dc9d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1282 microversion: 2.20 time: 0.098086 Sep 22 22:18:35.058560 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 378/775] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:34 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:35.134419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:35.142369 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-46ca416d-8613-4ae8-8515-42d44966c5ef tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1576 microversion: 2.1 time: 0.244840 Sep 22 22:18:35.143125 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 398/776] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:34 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:35.437200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-781b16e3-65e8-4d93-b791-a621d923ee54 req-7c265144-29e5-42cb-9b88-e0f44e2e222a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e642fd-e734-4624-b2be-6fd3141f7a8c", "name": "network-vif-deleted", "tag": "bdfb86dd-821c-462a-a36c-ab4f3c618d51"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:35.449641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-781b16e3-65e8-4d93-b791-a621d923ee54 req-7c265144-29e5-42cb-9b88-e0f44e2e222a service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:35.450129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-781b16e3-65e8-4d93-b791-a621d923ee54 req-7c265144-29e5-42cb-9b88-e0f44e2e222a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:35.450561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-781b16e3-65e8-4d93-b791-a621d923ee54 req-7c265144-29e5-42cb-9b88-e0f44e2e222a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:35.462201 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-781b16e3-65e8-4d93-b791-a621d923ee54 req-7c265144-29e5-42cb-9b88-e0f44e2e222a service nova] Creating event network-vif-deleted:bdfb86dd-821c-462a-a36c-ab4f3c618d51 for instance a9e642fd-e734-4624-b2be-6fd3141f7a8c on hv-cinder-84914 Sep 22 22:18:35.468737 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-781b16e3-65e8-4d93-b791-a621d923ee54 req-7c265144-29e5-42cb-9b88-e0f44e2e222a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034851 Sep 22 22:18:35.469430 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 379/777] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:36.086594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd4f9807-0803-4b5d-8328-3b5c066d5716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:36.087445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd4f9807-0803-4b5d-8328-3b5c066d5716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:36.167990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:36.169329 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:36.178121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:36.179217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:36.180172 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:36.181128 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:36.181802 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:36.182467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:36.199254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd4f9807-0803-4b5d-8328-3b5c066d5716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:36.214411 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd4f9807-0803-4b5d-8328-3b5c066d5716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:36.216635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd4f9807-0803-4b5d-8328-3b5c066d5716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:36.218352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd4f9807-0803-4b5d-8328-3b5c066d5716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1282 microversion: 2.20 time: 0.138327 Sep 22 22:18:36.219321 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 399/778] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:36 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:36.232108 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:36.232655 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:36.233095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:36.233655 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lazy-loading 'fault' on Instance uuid a9e642fd-e734-4624-b2be-6fd3141f7a8c {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:18:36.290145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:36.300415 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-53d95da0-f650-4a56-a8d7-e82e02414a39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 200 len: 1231 microversion: 2.1 time: 0.136673 Sep 22 22:18:36.301020 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 380/779] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:36 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 1231 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:37.243483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:37.244088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:37.250961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:37.251435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:37.251868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:37.252544 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:37.252990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:37.253438 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:37.313694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:37.322041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:37.323642 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:37.324253 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:37.324362 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:37.325602 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dbcf4df6-1bd3-41e6-9fe0-f9ea5995d701 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1286 microversion: 2.20 time: 0.086119 Sep 22 22:18:37.326354 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 400/780] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:37 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:37.331446 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:37.331591 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:37.331958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:37.332737 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:37.333087 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:37.334135 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:37.347741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] HTTP exception thrown: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Request method failure captured: Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c HTTP/1.1 Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN5fB_4_ew08rsyhBLN9O6VJu31nmwQS0LA3oE33R_nNZFMHJj7Tw72cGdsUZP9h0qRuDkNnTAV_OMVKZmOYOH6L_A-eyb1uThZIqzBGKqZZ3Q7Iyp9I2IgBLMk06q5qwb0nIMPOWBijmVc3llIYZbAE9CaP_fyvNx-HTItTupueFd4 Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:18:37.350095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9c311fa04f241249d428df8e88539f4", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestVolumeBootPattern-899794602 Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: cc89baeb82444da78312c4b0b3fb0c41 Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:18:37.351831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': 'a9e642fd-e734-4624-b2be-6fd3141f7a8c'} Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:18:37.352759 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:18:37.354267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:37.355695 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Returning 404 to user: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:18:37.355695 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9299a902-687c-4d1e-9aa2-b79227458025 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 404 len: 111 microversion: 2.1 time: 0.031688 Sep 22 22:18:37.355695 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 381/781] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:37 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 22:18:37.449488 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1192535910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1122905243", "security_groups": [{"name": "tempest-secgroup-smoke-67558175"}], "block_device_mapping_v2": [{"uuid": "f12dab85-c93e-412c-93c4-1d67f89da498", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c773c61e-e7b7-47c6-998a-83ddea69af57"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:37.563289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] validate_networks() for [('c773c61e-e7b7-47c6-998a-83ddea69af57', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:18:37.935316 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:18:37.935742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:18:37.936215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:18:37.936620 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:18:37.937032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:18:37.946174 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:37.946656 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:37.947115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:37.947843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:37.948327 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:37.948748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:37.965634 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Getting quotas for project e9c311fa04f241249d428df8e88539f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:18:37.969356 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Getting quotas for user cc89baeb82444da78312c4b0b3fb0c41 and project e9c311fa04f241249d428df8e88539f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:18:38.027373 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:18:38.029481 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f12dab85-c93e-412c-93c4-1d67f89da498',volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:18:38.165181 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8168336e-2a39-46a4-9395-915d45813010 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.719280 Sep 22 22:18:38.166485 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 401/782] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:18:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:18:38.177780 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-786edbfb-c258-41e9-8a8f-ec4dba54af0f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:38.178677 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-786edbfb-c258-41e9-8a8f-ec4dba54af0f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:38.258307 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-786edbfb-c258-41e9-8a8f-ec4dba54af0f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:38.269094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-786edbfb-c258-41e9-8a8f-ec4dba54af0f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1095 microversion: 2.1 time: 0.095366 Sep 22 22:18:38.270405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 382/783] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:38 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:38.351876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:38.352481 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:38.358504 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:38.358992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:38.359423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:38.360112 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:38.360569 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:38.360990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:38.424444 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:38.433328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:38.434776 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:38.435884 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-64be7ffc-a574-4758-bc80-9ba97d2850c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1340 microversion: 2.20 time: 0.088352 Sep 22 22:18:38.436448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 402/784] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:38 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:39.292203 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:39.292820 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:39.299975 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:39.300460 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:39.300898 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:39.301624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:39.302083 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:39.302525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:39.386399 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:39.394696 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4855d932-3a68-4b52-8b5d-171de98c9499 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1193 microversion: 2.1 time: 0.106322 Sep 22 22:18:39.395268 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 383/785] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:39 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:39.461873 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:39.462585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:39.469307 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:39.470015 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:39.470633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:39.471560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:39.472015 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:39.472434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:40.005890 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:40.014098 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:40.015740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:40.016872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a355481c-3c32-40be-9a66-22619f5c1a43 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1407 microversion: 2.20 time: 0.559042 Sep 22 22:18:40.017533 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 403/786] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:39 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:40.272929 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-6ddac9de-aebf-4db0-bb0b-3c485adcb6e7 req-71bb133c-84f6-4d90-ad96-46bd31b8db41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03073c72-a5ba-4bab-90eb-f92f0396c092", "tag": "c8ece83a-0238-40e0-9d0d-3d28f90f9abf"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:40.289638 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6ddac9de-aebf-4db0-bb0b-3c485adcb6e7 req-71bb133c-84f6-4d90-ad96-46bd31b8db41 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:40.290379 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6ddac9de-aebf-4db0-bb0b-3c485adcb6e7 req-71bb133c-84f6-4d90-ad96-46bd31b8db41 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:40.291012 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6ddac9de-aebf-4db0-bb0b-3c485adcb6e7 req-71bb133c-84f6-4d90-ad96-46bd31b8db41 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:40.307050 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-6ddac9de-aebf-4db0-bb0b-3c485adcb6e7 req-71bb133c-84f6-4d90-ad96-46bd31b8db41 service nova] Creating event network-changed:c8ece83a-0238-40e0-9d0d-3d28f90f9abf for instance 03073c72-a5ba-4bab-90eb-f92f0396c092 on hv-cinder-84914 Sep 22 22:18:40.311741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-6ddac9de-aebf-4db0-bb0b-3c485adcb6e7 req-71bb133c-84f6-4d90-ad96-46bd31b8db41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042855 Sep 22 22:18:40.312667 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 384/787] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:40.418328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:40.418889 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:40.425559 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:40.426199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:40.426638 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:40.428130 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:40.428725 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:40.429265 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:40.544951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:40.553216 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-67758086-ce8d-4879-80c5-2867c3d8dd11 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1199 microversion: 2.1 time: 0.138154 Sep 22 22:18:40.553843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 404/788] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:40 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1199 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:41.045660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:41.046363 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:41.062193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:41.072282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:41.072988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:41.073974 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:41.074467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:41.074900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:41.274324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:41.282487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:41.284079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:41.285215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e2b10d80-b937-404e-91df-a61d700d5302 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1407 microversion: 2.20 time: 0.245385 Sep 22 22:18:41.285775 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 385/789] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:41 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:41.578078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:41.579135 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:41.586954 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:41.587449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:41.587880 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:41.588585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:41.589036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:41.589484 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:41.801540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:41.810165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-35f73d13-e011-463b-a3a4-14edb0658e0c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.237077 Sep 22 22:18:41.810752 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 405/790] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:41 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:42.313785 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:42.314317 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:42.320800 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:42.321330 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:42.321760 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:42.322452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:42.322964 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:42.323390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:42.329066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c487c2d1-6203-4ce5-969f-de224391fda5 req-d5d56d2c-d67c-409b-a4a7-d0eca62457bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbebf564-cdc8-496b-9257-1de15ce25ca5", "tag": "df43b20d-bd58-4303-8444-f7ed51aa3a97"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:42.340277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c487c2d1-6203-4ce5-969f-de224391fda5 req-d5d56d2c-d67c-409b-a4a7-d0eca62457bf service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:42.340562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c487c2d1-6203-4ce5-969f-de224391fda5 req-d5d56d2c-d67c-409b-a4a7-d0eca62457bf service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:42.341138 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c487c2d1-6203-4ce5-969f-de224391fda5 req-d5d56d2c-d67c-409b-a4a7-d0eca62457bf service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:42.352312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c487c2d1-6203-4ce5-969f-de224391fda5 req-d5d56d2c-d67c-409b-a4a7-d0eca62457bf service nova] Creating event network-changed:df43b20d-bd58-4303-8444-f7ed51aa3a97 for instance fbebf564-cdc8-496b-9257-1de15ce25ca5 on hv-cinder-84914 Sep 22 22:18:42.357219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-c487c2d1-6203-4ce5-969f-de224391fda5 req-d5d56d2c-d67c-409b-a4a7-d0eca62457bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031878 Sep 22 22:18:42.357814 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 406/791] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:18:42.459831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:42.467724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:42.469170 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:42.470274 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fe629638-153a-43e2-b35c-e28b2cbf6879 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1407 microversion: 2.20 time: 0.160586 Sep 22 22:18:42.470831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 386/792] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:42 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:42.839164 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:42.839849 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:42.846720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:42.847198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:42.847625 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:42.848295 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:42.848742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:42.849183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:42.976953 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:42.984692 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7c1aab04-3b52-4b53-a447-8d8115efc533 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.149664 Sep 22 22:18:42.985282 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 407/793] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:42 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:43.496595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:43.497283 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:43.503685 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:43.504171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:43.504605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:43.506025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:43.506435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:43.506860 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:43.820647 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:43.829898 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:43.831657 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:43.832880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-67a6d6b5-8462-4fdd-8430-0dbc6a44fb36 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1407 microversion: 2.20 time: 0.340219 Sep 22 22:18:43.833487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 387/794] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:43 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:44.006735 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:44.007333 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:44.014085 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:44.014578 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:44.015018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:44.015717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:44.016176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:44.016604 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:44.555406 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:44.563095 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d2291efd-0f86-45c5-ae8c-46bcb976bbe0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.560291 Sep 22 22:18:44.563761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 408/795] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:44 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:44.860193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:44.860858 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:44.863903 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 22:18:44.864049 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Thu Sep 22 22:18:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 (ip 10.222.0.25) !!! Sep 22 22:18:44.873608 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:44.874278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:44.874854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:44.875648 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:44.876528 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:44.876662 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:45.010768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:45.019278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:45.020924 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:45.022230 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cc41838b-3199-4680-b903-9caadf21f5b6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1407 microversion: 2.20 time: 0.166243 Sep 22 22:18:45.022810 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 388/796] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:44 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:45.587351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:45.587961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:45.594701 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:45.595189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:45.595624 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:45.596311 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:45.596768 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:45.597224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:45.729294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:45.737048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3d421f7a-3841-4cd5-a405-7eedc115b459 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.154472 Sep 22 22:18:45.737640 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 409/797] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:45 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:46.047704 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:46.048315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:46.054833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:46.055315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:46.055752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:46.056446 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:46.056893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:46.057414 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:46.185849 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:46.194432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:46.195852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:46.196938 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3622e1e2-c90a-44f4-b1b5-0ee3b1089d59 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1407 microversion: 2.20 time: 0.153125 Sep 22 22:18:46.197536 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 389/798] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:46 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:46.760521 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:46.761844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:46.767533 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:46.768023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:46.768463 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:46.769174 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:46.769661 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:46.770094 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:46.908460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:46.916428 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2c2da8ba-4b8f-4f6b-a538-b111411278dd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.159792 Sep 22 22:18:46.916995 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 410/799] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:46 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:47.146590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-2da239aa-01ca-4ad8-897d-941714e368f9 req-913dc2f9-ffdc-46a5-823c-958b66e1a51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03073c72-a5ba-4bab-90eb-f92f0396c092", "name": "network-vif-plugged", "status": "completed", "tag": "c8ece83a-0238-40e0-9d0d-3d28f90f9abf"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:47.157836 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2da239aa-01ca-4ad8-897d-941714e368f9 req-913dc2f9-ffdc-46a5-823c-958b66e1a51b service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:47.158325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2da239aa-01ca-4ad8-897d-941714e368f9 req-913dc2f9-ffdc-46a5-823c-958b66e1a51b service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:47.158736 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2da239aa-01ca-4ad8-897d-941714e368f9 req-913dc2f9-ffdc-46a5-823c-958b66e1a51b service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:47.170032 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-2da239aa-01ca-4ad8-897d-941714e368f9 req-913dc2f9-ffdc-46a5-823c-958b66e1a51b service nova] Creating event network-vif-plugged:c8ece83a-0238-40e0-9d0d-3d28f90f9abf for instance 03073c72-a5ba-4bab-90eb-f92f0396c092 on hv-cinder-84914 Sep 22 22:18:47.174959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-2da239aa-01ca-4ad8-897d-941714e368f9 req-913dc2f9-ffdc-46a5-823c-958b66e1a51b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032092 Sep 22 22:18:47.175745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 390/800] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:47.221823 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:47.222430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:47.228910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:47.229426 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:47.229885 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:47.230602 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:47.231054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:47.231902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:47.367360 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:47.375387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:47.376830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:47.377969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b275d8bb-2b98-4643-b52b-b9260c967ff8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1407 microversion: 2.20 time: 0.160081 Sep 22 22:18:47.378529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 411/801] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:47 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:47.939939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:47.940623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:47.947033 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:47.947592 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:47.948021 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:47.948727 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:47.949225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:47.949647 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:48.078368 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:48.086745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b4c957c4-a067-45d7-b811-4bde6d8a8fa9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.151005 Sep 22 22:18:48.087672 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 391/802] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:47 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:48.403334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:48.404254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:48.406351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:48.407016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=14 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:48.412925 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:48.413425 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:48.413860 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:48.414544 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:48.415002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:48.415423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:48.543334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:48.552398 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:48.553882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:48.554995 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-85e23f38-37ae-44b8-8e7d-d467213a0e26 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1407 microversion: 2.20 time: 0.155567 Sep 22 22:18:48.555553 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 412/803] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:48 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:49.110212 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:49.110816 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:49.113193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=12 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:49.113843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:49.120200 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:49.120672 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:49.121099 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:49.121798 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:49.122256 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:49.122667 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:49.256554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:49.265793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e748a70f-808a-4060-9f5e-f531d02e925b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.159463 Sep 22 22:18:49.266364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 392/804] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:49 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:49.581025 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:49.581641 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:49.588779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:49.589298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:49.589741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:49.590439 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:49.590896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:49.591322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:49.725362 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:49.733295 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:49.734778 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:49.735935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7b4dc643-b7ff-4c66-a95c-5880b8ff33b1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1600 microversion: 2.20 time: 0.158782 Sep 22 22:18:49.736497 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 413/805] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:18:49 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:18:49.761601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e33c6480-44db-47e2-88c3-6fec32e86c68 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:49.762094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e33c6480-44db-47e2-88c3-6fec32e86c68 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:49.767938 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e33c6480-44db-47e2-88c3-6fec32e86c68 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:49.768412 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e33c6480-44db-47e2-88c3-6fec32e86c68 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:49.768842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e33c6480-44db-47e2-88c3-6fec32e86c68 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:49.769987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e33c6480-44db-47e2-88c3-6fec32e86c68 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:49.769987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e33c6480-44db-47e2-88c3-6fec32e86c68 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:49.771167 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e33c6480-44db-47e2-88c3-6fec32e86c68 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:49.851054 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e33c6480-44db-47e2-88c3-6fec32e86c68 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093261 Sep 22 22:18:49.851650 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 393/806] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Sep 22 22:18:49 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 22:18:50.172272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-281b6925-48c2-4860-bbe0-29ceb0e1f5d6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:50.172761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-281b6925-48c2-4860-bbe0-29ceb0e1f5d6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:50.178675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-281b6925-48c2-4860-bbe0-29ceb0e1f5d6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:50.179157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-281b6925-48c2-4860-bbe0-29ceb0e1f5d6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:50.179585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-281b6925-48c2-4860-bbe0-29ceb0e1f5d6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:50.180288 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-281b6925-48c2-4860-bbe0-29ceb0e1f5d6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:50.180714 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-281b6925-48c2-4860-bbe0-29ceb0e1f5d6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:50.181146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-281b6925-48c2-4860-bbe0-29ceb0e1f5d6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:50.203659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-281b6925-48c2-4860-bbe0-29ceb0e1f5d6 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/ips" status: 200 len: 149 microversion: 2.1 time: 0.035182 Sep 22 22:18:50.204223 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 414/807] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:18:50 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:50.291352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:50.291971 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:50.298666 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:50.299338 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:50.299875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:50.300666 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:50.301237 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:50.301993 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:50.556399 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:50.564257 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-156d3ffc-c79d-4399-980b-3684c0995cbb tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.278982 Sep 22 22:18:50.564916 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 394/808] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:50 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:50.872951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-e910ca62-5ecc-4f1e-92ef-2f023d4845cd req-b843591a-123c-4a31-ba61-2d742a26042f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03073c72-a5ba-4bab-90eb-f92f0396c092", "tag": "c8ece83a-0238-40e0-9d0d-3d28f90f9abf"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:50.882673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e910ca62-5ecc-4f1e-92ef-2f023d4845cd req-b843591a-123c-4a31-ba61-2d742a26042f service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:50.883576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e910ca62-5ecc-4f1e-92ef-2f023d4845cd req-b843591a-123c-4a31-ba61-2d742a26042f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:50.883576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e910ca62-5ecc-4f1e-92ef-2f023d4845cd req-b843591a-123c-4a31-ba61-2d742a26042f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:50.894697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-e910ca62-5ecc-4f1e-92ef-2f023d4845cd req-b843591a-123c-4a31-ba61-2d742a26042f service nova] Creating event network-changed:c8ece83a-0238-40e0-9d0d-3d28f90f9abf for instance 03073c72-a5ba-4bab-90eb-f92f0396c092 on hv-cinder-84914 Sep 22 22:18:50.900599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-e910ca62-5ecc-4f1e-92ef-2f023d4845cd req-b843591a-123c-4a31-ba61-2d742a26042f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031209 Sep 22 22:18:50.901212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 415/809] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:51.560256 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-94b4d1cc-d2f2-4ad7-8841-bc3eb8d9c009 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "943b52e5-41a3-4232-bda9-08535f32ef61"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:51.562762 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-94b4d1cc-d2f2-4ad7-8841-bc3eb8d9c009 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:51.570418 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b4d1cc-d2f2-4ad7-8841-bc3eb8d9c009 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:51.570902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b4d1cc-d2f2-4ad7-8841-bc3eb8d9c009 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:51.571337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b4d1cc-d2f2-4ad7-8841-bc3eb8d9c009 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:51.572034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b4d1cc-d2f2-4ad7-8841-bc3eb8d9c009 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:51.572488 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b4d1cc-d2f2-4ad7-8841-bc3eb8d9c009 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:51.572911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b4d1cc-d2f2-4ad7-8841-bc3eb8d9c009 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:51.587816 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:51.588807 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:51.592829 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:51.596079 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:51.596575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:51.597013 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:51.597964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:51.598865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:51.599590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:51.620936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:18:51.739443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:51.747593 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3a1ae238-eb87-4e5a-a0cb-20fe16f6bde3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.164054 Sep 22 22:18:51.748166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 416/810] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:51 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:18:52.202340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-94b4d1cc-d2f2-4ad7-8841-bc3eb8d9c009 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646104 Sep 22 22:18:52.209173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 395/811] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:18:51 2022] POST /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:18:52.771304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:52.771908 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:52.779069 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:52.779546 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:52.779972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:52.780658 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:52.781131 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:52.781547 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:52.921203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:52.929572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a8ebba62-bd92-4192-a4e7-d2130bc99c86 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.162217 Sep 22 22:18:52.930129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 417/812] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:52 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:53.953406 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:53.954008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:53.961240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:53.961724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:53.962157 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:53.962845 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:53.963295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:53.963713 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:54.092762 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:54.100481 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a2112381-568c-4a54-914b-54bf490d035f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.151408 Sep 22 22:18:54.101043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 396/813] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:53 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:55.123147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:55.123866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:55.130392 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:55.130876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:55.131312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:55.131999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:55.132456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:55.132887 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:55.173605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-92680417-4bb0-47d1-9f2f-937b591be95d req-953c0a60-35e3-41bd-bdba-890ed472f127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbebf564-cdc8-496b-9257-1de15ce25ca5", "name": "network-vif-plugged", "status": "completed", "tag": "df43b20d-bd58-4303-8444-f7ed51aa3a97"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:55.186157 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-92680417-4bb0-47d1-9f2f-937b591be95d req-953c0a60-35e3-41bd-bdba-890ed472f127 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:55.186642 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-92680417-4bb0-47d1-9f2f-937b591be95d req-953c0a60-35e3-41bd-bdba-890ed472f127 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:55.187238 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-92680417-4bb0-47d1-9f2f-937b591be95d req-953c0a60-35e3-41bd-bdba-890ed472f127 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:55.199162 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-92680417-4bb0-47d1-9f2f-937b591be95d req-953c0a60-35e3-41bd-bdba-890ed472f127 service nova] Creating event network-vif-plugged:df43b20d-bd58-4303-8444-f7ed51aa3a97 for instance fbebf564-cdc8-496b-9257-1de15ce25ca5 on hv-cinder-84914 Sep 22 22:18:55.203937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-92680417-4bb0-47d1-9f2f-937b591be95d req-953c0a60-35e3-41bd-bdba-890ed472f127 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034136 Sep 22 22:18:55.204716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 397/814] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:18:55.270855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:55.278756 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1788e23a-4d50-4392-8fbe-6936c117cafd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.159513 Sep 22 22:18:55.279329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 418/815] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:55 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:56.302377 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:56.303179 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:56.309308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:56.309731 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:56.310162 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:56.310837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:56.311289 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:56.311703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:56.439798 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:56.448054 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0796004-bd5e-4fe7-9bf0-d59db4a8d859 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1265 microversion: 2.1 time: 0.150361 Sep 22 22:18:56.448635 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 398/816] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:56 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:56.977759 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ed2139cf-3de0-4dbe-8c55-6b48ef2dddeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:56.979866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ed2139cf-3de0-4dbe-8c55-6b48ef2dddeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:56.986304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed2139cf-3de0-4dbe-8c55-6b48ef2dddeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:56.986788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed2139cf-3de0-4dbe-8c55-6b48ef2dddeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:56.987222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed2139cf-3de0-4dbe-8c55-6b48ef2dddeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:56.987907 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed2139cf-3de0-4dbe-8c55-6b48ef2dddeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:56.988371 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed2139cf-3de0-4dbe-8c55-6b48ef2dddeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:56.988797 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ed2139cf-3de0-4dbe-8c55-6b48ef2dddeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:57.018729 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ed2139cf-3de0-4dbe-8c55-6b48ef2dddeb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045398 Sep 22 22:18:57.019272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 419/817] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:18:56 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 22:18:57.083643 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:57.084167 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:57.090021 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:57.090497 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:57.090923 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:57.091606 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:57.092052 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:57.092467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:57.119918 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:18:57.193937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ac63df7c-c59b-4a5b-957c-183d931c5922 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 204 len: 0 microversion: 2.1 time: 0.114503 Sep 22 22:18:57.194520 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 399/818] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:18:57 2022] DELETE /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:18:57.202675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:57.203284 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:57.209849 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:57.210333 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:57.210771 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:57.211450 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:57.211922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:57.212329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:57.344208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:57.351975 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bb995065-f406-4560-a36c-ea4b66fedd3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1674 microversion: 2.1 time: 0.153065 Sep 22 22:18:57.352535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 420/819] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:57 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:57.471525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:57.472137 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:57.478727 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:57.479216 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:57.479654 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:57.480347 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:57.481009 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:57.481535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:57.611981 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:57.620167 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dd6a234e-6490-4028-b95a-118957c726ff tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1452 microversion: 2.1 time: 0.153039 Sep 22 22:18:57.620734 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 400/820] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:57 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:57.642532 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:57.643138 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:57.649140 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:57.649632 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:57.650071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:57.650757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:57.651210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:57.651631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:57.782433 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:57.790819 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dabfa425-a9fe-4bfb-a1f2-8ff1266aa76b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1452 microversion: 2.1 time: 0.152005 Sep 22 22:18:57.791390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 421/821] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:57 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:58.375486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:58.375987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:58.381894 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:58.382380 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:58.382818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:58.383518 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:58.383982 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:58.384411 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:58.609246 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:58.617725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-af76544f-34cb-4507-a65e-37cfad34d823 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1674 microversion: 2.1 time: 0.246292 Sep 22 22:18:58.618321 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 401/822] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:58 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1674 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:59.648571 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:59.649226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:59.657439 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:59.665941 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:59.665941 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:59.668676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:59.669410 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:59.670059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:59.769000 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "943b52e5-41a3-4232-bda9-08535f32ef61"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:59.771771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:18:59.788107 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:59.788826 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:59.789302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:59.790284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:59.790953 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:59.791381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:59.892351 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Invalid volume: volume 943b52e5-41a3-4232-bda9-08535f32ef61 is already attached to instances: c0d604e6-1975-480b-ac89-1fa7caf675f4 Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: POST /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments HTTP/1.1 Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 74 Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:18:59.894183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {"volumeAttachment": {"volumeId": "943b52e5-41a3-4232-bda9-08535f32ef61"}} Sep 22 22:18:59.896423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Invalid volume: volume 943b52e5-41a3-4232-bda9-08535f32ef61 is already attached to instances: c0d604e6-1975-480b-ac89-1fa7caf675f4 Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'server_id': 'c0d604e6-1975-480b-ac89-1fa7caf675f4', 'body': {'volumeAttachment': {'volumeId': '943b52e5-41a3-4232-bda9-08535f32ef61'}}} Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 943b52e5-41a3-4232-bda9-08535f32ef61 is already attached to instances: c0d604e6-1975-480b-ac89-1fa7caf675f4 Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:59.897340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 943b52e5-41a3-4232-bda9-08535f32ef61 is already attached to instances: c0d604e6-1975-480b-ac89-1fa7caf675f4 Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:18:59.898559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:18:59.899852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:18:59.899852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:18:59.899852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:18:59.899852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 943b52e5-41a3-4232-bda9-08535f32ef61 is already attached to instances: c0d604e6-1975-480b-ac89-1fa7caf675f4 Sep 22 22:18:59.899852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:18:59.905416 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 400 to user: Invalid volume: volume 943b52e5-41a3-4232-bda9-08535f32ef61 is already attached to instances: c0d604e6-1975-480b-ac89-1fa7caf675f4 {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:18:59.906571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-57f3d9b5-e149-4f82-9d78-e8b98c30b132 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.141683 Sep 22 22:18:59.907282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 402/823] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:18:59 2022] POST /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 22 22:18:59.971409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-84a93b09-6c8f-4016-a30b-5b546b46ca54 req-0176904c-fc69-4bb8-90a2-3ff6ee939724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbebf564-cdc8-496b-9257-1de15ce25ca5", "tag": "df43b20d-bd58-4303-8444-f7ed51aa3a97"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:18:59.981348 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:18:59.982595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-84a93b09-6c8f-4016-a30b-5b546b46ca54 req-0176904c-fc69-4bb8-90a2-3ff6ee939724 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:18:59.983184 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-84a93b09-6c8f-4016-a30b-5b546b46ca54 req-0176904c-fc69-4bb8-90a2-3ff6ee939724 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:18:59.983716 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-84a93b09-6c8f-4016-a30b-5b546b46ca54 req-0176904c-fc69-4bb8-90a2-3ff6ee939724 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:18:59.990999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1aef9c4b-1090-4ffe-8757-609ba9ac03cd tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1674 microversion: 2.1 time: 0.351233 Sep 22 22:18:59.992162 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 422/824] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:18:59 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1674 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:18:59.996182 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-84a93b09-6c8f-4016-a30b-5b546b46ca54 req-0176904c-fc69-4bb8-90a2-3ff6ee939724 service nova] Creating event network-changed:df43b20d-bd58-4303-8444-f7ed51aa3a97 for instance fbebf564-cdc8-496b-9257-1de15ce25ca5 on hv-cinder-84914 Sep 22 22:18:59.997315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:18:59.997977 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:00.001139 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-84a93b09-6c8f-4016-a30b-5b546b46ca54 req-0176904c-fc69-4bb8-90a2-3ff6ee939724 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033619 Sep 22 22:19:00.002019 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 403/825] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:19:00.006435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:00.007109 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:00.007730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:00.008671 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:00.009345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:00.009928 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:00.107733 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lazy-loading 'services' on Instance uuid c0d604e6-1975-480b-ac89-1fa7caf675f4 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:19:00.191644 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8132d4af-a277-4fb5-820e-b20770d0bc8e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments/943b52e5-41a3-4232-bda9-08535f32ef61" status: 202 len: 0 microversion: 2.1 time: 0.197846 Sep 22 22:19:00.192576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 423/826] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:18:59 2022] DELETE /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments/943b52e5-41a3-4232-bda9-08535f32ef61 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:19:00.203057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e62f09fe-77c5-4746-bc05-db4add174c10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:00.205588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e62f09fe-77c5-4746-bc05-db4add174c10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:00.214743 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e62f09fe-77c5-4746-bc05-db4add174c10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:00.215232 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e62f09fe-77c5-4746-bc05-db4add174c10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:00.215663 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e62f09fe-77c5-4746-bc05-db4add174c10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:00.216358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e62f09fe-77c5-4746-bc05-db4add174c10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:00.216812 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e62f09fe-77c5-4746-bc05-db4add174c10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:00.217262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e62f09fe-77c5-4746-bc05-db4add174c10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:00.251387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e62f09fe-77c5-4746-bc05-db4add174c10 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054112 Sep 22 22:19:00.252267 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 404/827] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:19:00 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:19:01.020137 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:01.020896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:01.038968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:01.039674 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:01.041688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:01.043084 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:01.044155 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:01.045136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:01.203464 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:01.217164 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7bb691d4-2014-4cc1-874c-f8d465e2619d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1607 microversion: 2.1 time: 0.201809 Sep 22 22:19:01.218634 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 424/828] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:01 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1607 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:01.264664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-465f7d05-3fc9-4d62-9d39-20529455cb56 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:01.267687 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-465f7d05-3fc9-4d62-9d39-20529455cb56 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:01.284741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-465f7d05-3fc9-4d62-9d39-20529455cb56 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:01.286845 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-465f7d05-3fc9-4d62-9d39-20529455cb56 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:01.287742 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-465f7d05-3fc9-4d62-9d39-20529455cb56 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:01.290618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-465f7d05-3fc9-4d62-9d39-20529455cb56 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:01.291229 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-465f7d05-3fc9-4d62-9d39-20529455cb56 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:01.291830 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-465f7d05-3fc9-4d62-9d39-20529455cb56 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:01.356343 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-465f7d05-3fc9-4d62-9d39-20529455cb56 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095602 Sep 22 22:19:01.357347 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 405/829] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:19:01 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 22:19:01.450230 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:01.451037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:01.457836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:01.458795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:01.459546 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:01.461074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:01.461741 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:01.462907 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:01.493742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:19:01.591618 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-98b89ed3-33f8-4e06-a1ac-9c649a723bfb tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 204 len: 0 microversion: 2.1 time: 0.146060 Sep 22 22:19:01.592933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 425/830] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:19:01 2022] DELETE /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:19:01.605293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:01.605983 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:01.611956 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:01.612668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:01.613735 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:01.614470 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:01.614917 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:01.615332 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:01.757480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:01.766305 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-71b4ee37-f0f8-4611-a000-2c2662a88902 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1679 microversion: 2.1 time: 0.167014 Sep 22 22:19:01.766883 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 406/831] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:01 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:02.045986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-35584b68-65ca-43a5-96b5-420fdc4f3c1d req-cff9898a-702a-46d1-9049-e4cfc2ee2c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8", "name": "network-vif-deleted", "tag": "3ab370e5-8611-4fef-bf09-955dd5a94603"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:02.057157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-35584b68-65ca-43a5-96b5-420fdc4f3c1d req-cff9898a-702a-46d1-9049-e4cfc2ee2c5d service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:02.057752 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-35584b68-65ca-43a5-96b5-420fdc4f3c1d req-cff9898a-702a-46d1-9049-e4cfc2ee2c5d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:02.058492 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-35584b68-65ca-43a5-96b5-420fdc4f3c1d req-cff9898a-702a-46d1-9049-e4cfc2ee2c5d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:02.070551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-35584b68-65ca-43a5-96b5-420fdc4f3c1d req-cff9898a-702a-46d1-9049-e4cfc2ee2c5d service nova] Creating event network-vif-deleted:3ab370e5-8611-4fef-bf09-955dd5a94603 for instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 on hv-cinder-84914 Sep 22 22:19:02.076708 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-35584b68-65ca-43a5-96b5-420fdc4f3c1d req-cff9898a-702a-46d1-9049-e4cfc2ee2c5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035404 Sep 22 22:19:02.077445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 426/832] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:02.243914 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:02.244435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:02.250765 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:02.251250 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:02.251683 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:02.252372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:02.252825 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:02.253287 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:02.286533 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:02.287199 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:02.287429 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:02.287867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lazy-loading 'fault' on Instance uuid fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:19:02.327334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:02.335400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2fdf6e80-1742-40a6-a7f9-1ba193de6cb6 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1328 microversion: 2.1 time: 0.095553 Sep 22 22:19:02.335964 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 407/833] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:02 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:02.791066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:02.791748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:02.793875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:02.800172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:02.800691 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:02.801213 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:02.802403 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:02.802846 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:02.803261 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:02.935350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:02.943701 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-08fed459-77ca-4db7-92c1-414c4d73e6c7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1679 microversion: 2.1 time: 0.156753 Sep 22 22:19:02.944261 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 427/834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:02 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:03.358816 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:03.359378 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:03.366523 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:03.367002 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:03.367438 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:03.368124 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:03.368571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:03.368987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:03.402300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:03.402781 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:03.403239 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:03.403732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lazy-loading 'fault' on Instance uuid fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:19:03.450064 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:03.457300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6746de13-25c2-4ae0-9dd9-dd1a7b8a0f45 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 200 len: 1328 microversion: 2.1 time: 0.102330 Sep 22 22:19:03.458470 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 408/835] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:03 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:03.966519 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:03.967124 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:03.973532 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:03.974008 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:03.974440 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:03.975151 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:03.975601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:03.976018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:04.183997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:04.191638 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2279e520-d87f-46c5-99c5-24a3d5fc5ea2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1679 microversion: 2.1 time: 0.228903 Sep 22 22:19:04.192890 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 428/836] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:03 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:04.480903 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:04.481568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:04.488310 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:04.488807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:04.489871 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:04.490595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:04.491072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:04.491490 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:04.506185 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] HTTP exception thrown: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Request method failure captured: Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 HTTP/1.1 Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN3N0Kbkdxavu16xjx6CjZQIsWrRa9uuMMpdKqZo6po00pKu5iCwKq8Y4SdlXOTtK3R467UMp6JFNUizfVhqsWMD3JjwGoQEpm63AaxxAePB0cnZABdApjgYymtkObf2_ajlagaDmXXKvPMLbvCP7uTQVDMa2oV4A2u4EAOHREBu44g Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:19:04.507294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/650863eae15e4733b50e22c7595d7742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_650863eae15e4733b50e22c7595d7742", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 62e294148e14459a96190fab931d4898 Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:19:04.508943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': 'fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8'} Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:19:04.509915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:19:04.511540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:04.512818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Returning 404 to user: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:19:04.512818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c4f18963-0640-4139-8b62-1a7d8b80748c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 404 len: 111 microversion: 2.1 time: 0.031637 Sep 22 22:19:04.512818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 409/837] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:04 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:19:04.518089 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ed339e99-2750-4891-8c42-5fe5d84f0b2e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '.version_select at 0x7f405caa1040>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:04.548842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ed339e99-2750-4891-8c42-5fe5d84f0b2e tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480948822" status: 202 len: 0 microversion: 2.1 time: 0.034536 Sep 22 22:19:04.549479 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 429/838] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 22 22:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480948822 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:19:04.839222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-dc30547d-a43c-402d-9677-9dcbaad1419d req-9fb8c3c1-44fa-4136-bbf1-02fb1e175703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d604e6-1975-480b-ac89-1fa7caf675f4", "name": "network-vif-deleted", "tag": "84508ba9-197d-4731-a7d3-cb48ca241b0d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:04.853720 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-dc30547d-a43c-402d-9677-9dcbaad1419d req-9fb8c3c1-44fa-4136-bbf1-02fb1e175703 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:04.854390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-dc30547d-a43c-402d-9677-9dcbaad1419d req-9fb8c3c1-44fa-4136-bbf1-02fb1e175703 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:04.854994 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-dc30547d-a43c-402d-9677-9dcbaad1419d req-9fb8c3c1-44fa-4136-bbf1-02fb1e175703 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:04.879290 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-dc30547d-a43c-402d-9677-9dcbaad1419d req-9fb8c3c1-44fa-4136-bbf1-02fb1e175703 service nova] Creating event network-vif-deleted:84508ba9-197d-4731-a7d3-cb48ca241b0d for instance c0d604e6-1975-480b-ac89-1fa7caf675f4 on hv-cinder-84914 Sep 22 22:19:04.885934 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-dc30547d-a43c-402d-9677-9dcbaad1419d req-9fb8c3c1-44fa-4136-bbf1-02fb1e175703 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050299 Sep 22 22:19:04.889282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 410/839] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:05.224913 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:05.226139 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:05.232050 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:05.232534 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:05.233203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:05.234083 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:05.234549 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:05.234978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:05.242768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fa9e5c5f-ed2e-49e5-b6ea-e5dc5ba1127f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'create', calling method: .version_select at 0x7f405cb059d0>, body: {"keypair": {"name": "tempest-keypair-1831919075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkuV7bZk7RuA28EvHHkHgaIDJngmQMlykkUFfSCNYnSEJpqPDC/BoZps+Z2sSbfJtd9ObYPcqdy3+cVu9j7KyrFPcFtTH0VsWhlF0Y7kx8QUTJBat+kwkul2bEy/5z3EA=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:05.259863 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-fa9e5c5f-ed2e-49e5-b6ea-e5dc5ba1127f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Getting quotas for project 650863eae15e4733b50e22c7595d7742. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:19:05.263923 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-fa9e5c5f-ed2e-49e5-b6ea-e5dc5ba1127f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Getting quotas for user 62e294148e14459a96190fab931d4898 and project 650863eae15e4733b50e22c7595d7742. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:19:05.267000 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:05.267491 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:05.267938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:05.268381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lazy-loading 'fault' on Instance uuid c0d604e6-1975-480b-ac89-1fa7caf675f4 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:19:05.290895 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fa9e5c5f-ed2e-49e5-b6ea-e5dc5ba1127f tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052300 Sep 22 22:19:05.291492 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 411/840] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:19:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:05.313337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:05.322295 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d3f2d2ec-9d20-409a-9b8a-2e74c65496ee tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 200 len: 1331 microversion: 2.1 time: 0.103234 Sep 22 22:19:05.322822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 430/841] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:05 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:06.346858 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:06.347766 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:06.354910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:06.355409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:06.355846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:06.356557 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:06.357043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:06.357524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:06.362756 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:06.374260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 HTTP/1.1 Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:19:06.376037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:19:06.377778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': 'c0d604e6-1975-480b-ac89-1fa7caf675f4'} Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:19:06.378661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:19:06.380552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:06.381755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:19:06.381755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9f67f6b4-2f0d-46fa-9e90-9e5a48e91df8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 404 len: 111 microversion: 2.1 time: 0.035064 Sep 22 22:19:06.381755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 412/842] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:06 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:19:06.387635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-83a86ffd-076d-4a3d-bb60-ebf8bcf5f1dd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '.version_select at 0x7f405ca90430>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:06.406156 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-83a86ffd-076d-4a3d-bb60-ebf8bcf5f1dd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-662580538" status: 202 len: 0 microversion: 2.1 time: 0.022353 Sep 22 22:19:06.406847 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 431/843] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Sep 22 22:19:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-662580538 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:19:06.827715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1906725246", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c3478bc-b7f3-4988-80ed-a5eadeacc461"}], "security_groups": [{"name": "tempest-securitygroup--2131024784"}], "key_name": "tempest-keypair-1831919075", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:06.981094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] validate_networks() for [('5c3478bc-b7f3-4988-80ed-a5eadeacc461', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:19:07.154307 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-af21977d-0b2c-4bd5-8e92-55e438784a00 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: .version_select at 0x7f405cac15e0>, body: {"keypair": {"name": "tempest-keypair-942195074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKh8NXEXoPIFXUXs+sRsYPbYl6Pf07H6rNIqFxuOXn7g1O14JSgqgOvKvqD0vMKUiYtgwdY147JN8JOG7Bw/7E0AIrMlrW9h+FOp7cr1/mxFENwHUB/s5ruaO/hfyWQnbA=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:07.171253 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-af21977d-0b2c-4bd5-8e92-55e438784a00 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for project 226257b343d24054bc2178b47a9a5a4f. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:19:07.175132 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-af21977d-0b2c-4bd5-8e92-55e438784a00 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for user bcb617f1f41c467fba9717f7f825ac80 and project 226257b343d24054bc2178b47a9a5a4f. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:19:07.198872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-af21977d-0b2c-4bd5-8e92-55e438784a00 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048491 Sep 22 22:19:07.199482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 432/844] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:19:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:19:07.441811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:19:07.442849 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:19:07.443440 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:19:07.443851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:19:07.444263 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:19:07.453181 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:07.453670 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:07.454110 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:07.454842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:07.455298 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:07.455721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:07.474647 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Getting quotas for project 650863eae15e4733b50e22c7595d7742. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:19:07.478652 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Getting quotas for user 62e294148e14459a96190fab931d4898 and project 650863eae15e4733b50e22c7595d7742. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:19:07.490734 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:19:07.493322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:19:07.544475 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cc5d2a1b-eb99-4954-b23f-0c61dc3e6a33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.721934 Sep 22 22:19:07.545476 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 413/845] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:19:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:19:07.558457 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-49ed466d-6ad2-4883-b483-ad769612318b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:07.559084 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-49ed466d-6ad2-4883-b483-ad769612318b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:07.627448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-49ed466d-6ad2-4883-b483-ad769612318b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:07.636205 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-49ed466d-6ad2-4883-b483-ad769612318b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1238 microversion: 2.1 time: 0.082148 Sep 22 22:19:07.636901 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 433/846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:07 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:08.524295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-947878857", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76b70dbd-430e-4822-82a3-49c7f238d2e2"}], "security_groups": [{"name": "tempest-securitygroup--1910678579"}], "key_name": "tempest-keypair-942195074", "user_data": "}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:08.625460 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] validate_networks() for [('76b70dbd-430e-4822-82a3-49c7f238d2e2', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:19:08.662413 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:08.663656 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:08.671066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:08.671561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:08.672099 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:08.672804 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:08.673300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:08.673734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:08.751711 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:08.759538 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9b9b788f-f3d8-4987-a90b-dc99112699af tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1290 microversion: 2.1 time: 0.102367 Sep 22 22:19:08.760115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 434/847] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:08 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:19:09.156524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:19:09.157026 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:19:09.157509 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:19:09.157918 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:19:09.158328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:19:09.168227 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:09.168713 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:09.169174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:09.169909 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:09.170361 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:09.170789 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:09.188965 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for project 226257b343d24054bc2178b47a9a5a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:19:09.192782 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Getting quotas for user bcb617f1f41c467fba9717f7f825ac80 and project 226257b343d24054bc2178b47a9a5a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:19:09.203576 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:19:09.205923 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:19:09.253056 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-62e4f6bd-fc1c-4520-a205-10da7a589814 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.733740 Sep 22 22:19:09.260278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 414/848] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:19:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:19:09.265057 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-46a1ec07-a7e6-4a40-bbea-0a9ae8b2493b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:09.265749 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-46a1ec07-a7e6-4a40-bbea-0a9ae8b2493b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:09.361378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-46a1ec07-a7e6-4a40-bbea-0a9ae8b2493b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:09.372109 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-46a1ec07-a7e6-4a40-bbea-0a9ae8b2493b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1240 microversion: 2.1 time: 0.110720 Sep 22 22:19:09.373001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 435/849] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:09 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:19:09.790135 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:09.790818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:09.799108 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:09.799865 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:09.800306 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:09.801016 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:09.801564 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:09.802074 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:10.065137 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:10.075124 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f559c1ee-1d97-4a8d-a9b2-5ede14c12001 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1364 microversion: 2.1 time: 0.295056 Sep 22 22:19:10.076460 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 415/850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:09 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:10.394276 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:10.394937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:10.401533 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:10.402232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:10.402663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:10.403651 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:10.404116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:10.404535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:10.409395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:10.495809 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:10.505296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-98c29d3c-c47a-458e-8200-48dfbdd1a5c3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1292 microversion: 2.1 time: 0.113783 Sep 22 22:19:10.508144 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 436/851] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:10 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1292 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:10.608309 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-0d5f473d-cb40-410b-8c50-4c3ce446abf3 req-39789c98-e7b9-439e-9b92-5e7e5173b779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03", "tag": "0442a6b6-83cd-4999-8bc7-27ce501c9b84"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:10.625132 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:10.632127 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0d5f473d-cb40-410b-8c50-4c3ce446abf3 req-39789c98-e7b9-439e-9b92-5e7e5173b779 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:10.632734 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0d5f473d-cb40-410b-8c50-4c3ce446abf3 req-39789c98-e7b9-439e-9b92-5e7e5173b779 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:10.633782 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0d5f473d-cb40-410b-8c50-4c3ce446abf3 req-39789c98-e7b9-439e-9b92-5e7e5173b779 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:10.647251 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-0d5f473d-cb40-410b-8c50-4c3ce446abf3 req-39789c98-e7b9-439e-9b92-5e7e5173b779 service nova] Creating event network-changed:0442a6b6-83cd-4999-8bc7-27ce501c9b84 for instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 on hv-cinder-84914 Sep 22 22:19:10.652943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-0d5f473d-cb40-410b-8c50-4c3ce446abf3 req-39789c98-e7b9-439e-9b92-5e7e5173b779 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048416 Sep 22 22:19:10.654160 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 416/852] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:11.099706 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:11.100342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:11.106173 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:11.106652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:11.107080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:11.107765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:11.108211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:11.108628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:11.423832 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:11.432262 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ad2816cc-b434-4b01-9e08-435e289c53d9 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1364 microversion: 2.1 time: 0.336905 Sep 22 22:19:11.445492 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 437/853] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:11 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1364 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:11.529403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:11.530096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:11.536648 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:11.537160 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:11.537601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:11.538291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:11.538741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:11.539159 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:11.624800 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:11.633832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-98c3902d-937e-4a92-8b97-01c1cc65cc88 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1298 microversion: 2.1 time: 0.109204 Sep 22 22:19:11.634418 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 417/854] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:11 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:12.455757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:12.456360 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:12.463532 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:12.464013 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:12.464433 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:12.465140 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:12.465583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:12.465999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:12.595952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:12.604065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-add41150-6a28-4160-8de3-d875aa0430fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1364 microversion: 2.1 time: 0.152240 Sep 22 22:19:12.604622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 438/855] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:12 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:12.664829 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:12.665492 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:12.671973 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:12.672452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:12.672884 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:12.673599 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:12.674082 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:12.674505 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:12.801583 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:12.809182 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f7f6cd41-f42f-4b81-9a4f-d60f69c1fe59 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1366 microversion: 2.1 time: 0.149241 Sep 22 22:19:12.809752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 418/856] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:12 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:13.631446 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:13.632561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:13.639187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:13.639676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:13.640115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:13.640810 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:13.641317 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:13.641745 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:13.768845 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:13.777195 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-889509ed-c848-4953-bba0-24e6b826a15b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1364 microversion: 2.1 time: 0.150406 Sep 22 22:19:13.777779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 439/857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:13 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:13.833360 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:13.833969 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:13.840256 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:13.840730 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:13.841185 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:13.841872 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:13.842320 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:13.842738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:13.972419 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:13.980005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5909ba9b-a540-4e93-9edf-0257a9e54709 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1366 microversion: 2.1 time: 0.151862 Sep 22 22:19:13.980688 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 419/858] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:13 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:14.800119 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:14.800792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:14.807134 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:14.807622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:14.808056 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:14.808738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:14.809211 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:14.809632 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:15.005353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:15.006031 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:15.012732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:15.013487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:15.014070 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:15.015036 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:15.015476 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:15.015896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:15.185619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:15.198395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a58d16c1-c7c4-4cc5-8fc6-7b67c73bcc59 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1364 microversion: 2.1 time: 0.402251 Sep 22 22:19:15.207821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 440/859] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:14 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1364 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:15.282838 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:15.291634 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b3015ce0-f76e-47a0-8cf9-e8b3a1bb5ec7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1366 microversion: 2.1 time: 0.291391 Sep 22 22:19:15.301725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 420/860] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:14 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:15.390514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-745de6a4-5494-4f79-8c8a-f5e5284abf85 req-3ae3f9ca-8d71-4a1d-94f7-5db7bf6948d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fabbba-5575-4388-a3e4-2927edcb7026", "tag": "14a75f4e-b63a-4d20-adaa-5a0575ec7510"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:15.402823 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-745de6a4-5494-4f79-8c8a-f5e5284abf85 req-3ae3f9ca-8d71-4a1d-94f7-5db7bf6948d6 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:15.403333 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-745de6a4-5494-4f79-8c8a-f5e5284abf85 req-3ae3f9ca-8d71-4a1d-94f7-5db7bf6948d6 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:15.403766 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-745de6a4-5494-4f79-8c8a-f5e5284abf85 req-3ae3f9ca-8d71-4a1d-94f7-5db7bf6948d6 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:15.417061 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-745de6a4-5494-4f79-8c8a-f5e5284abf85 req-3ae3f9ca-8d71-4a1d-94f7-5db7bf6948d6 service nova] Creating event network-changed:14a75f4e-b63a-4d20-adaa-5a0575ec7510 for instance d1fabbba-5575-4388-a3e4-2927edcb7026 on hv-cinder-84914 Sep 22 22:19:15.421960 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-745de6a4-5494-4f79-8c8a-f5e5284abf85 req-3ae3f9ca-8d71-4a1d-94f7-5db7bf6948d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035258 Sep 22 22:19:15.422717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 441/861] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:19:16.220874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:16.221496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:16.227831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:16.228311 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:16.228747 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:16.229469 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:16.229923 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:16.230345 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:16.315697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:16.316924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:16.323264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:16.323730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:16.324159 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:16.324933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:16.325425 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:16.325848 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:16.364982 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:16.372827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-555a523a-dc28-4cc2-8a2e-1bae578ef340 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1364 microversion: 2.1 time: 0.155792 Sep 22 22:19:16.373439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 421/862] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:16 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:16.456084 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:16.464469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0268efc8-8e33-46d6-9f4b-5dee44d925f3 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1366 microversion: 2.1 time: 0.153463 Sep 22 22:19:16.465040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 442/863] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:16 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:19:16.669475 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-378607518"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:16.670012 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:16.676799 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:16.677413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:16.677851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:16.678568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:16.679021 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:16.679442 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:16.805870 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.network.security_group_api [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Removing security group 90e26c09-bad4-45d7-8865-b81a4507eb15 from port ad1f6820-de7a-484b-a76f-cd05b1b0347d Sep 22 22:19:17.114947 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e923debe-1357-4cdc-9e5f-1c2855c169e4 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "POST /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/action" status: 202 len: 0 microversion: 2.1 time: 0.449383 Sep 22 22:19:17.115569 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 422/864] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:19:16 2022] POST /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:19:17.397404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:17.398301 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:17.404575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:17.405670 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:17.406172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:17.406937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:17.407460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:17.408015 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:17.445796 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-b6c1a4a8-f9c3-494b-9703-5a76812acd1c req-c4fbe58a-1a64-498d-9986-37c43bfed238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8aead4-e4e9-4733-8351-1be87fd84dff", "tag": "ad1f6820-de7a-484b-a76f-cd05b1b0347d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:17.456564 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b6c1a4a8-f9c3-494b-9703-5a76812acd1c req-c4fbe58a-1a64-498d-9986-37c43bfed238 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:17.457565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b6c1a4a8-f9c3-494b-9703-5a76812acd1c req-c4fbe58a-1a64-498d-9986-37c43bfed238 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:17.458004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-b6c1a4a8-f9c3-494b-9703-5a76812acd1c req-c4fbe58a-1a64-498d-9986-37c43bfed238 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:17.470438 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-b6c1a4a8-f9c3-494b-9703-5a76812acd1c req-c4fbe58a-1a64-498d-9986-37c43bfed238 service nova] Creating event network-changed:ad1f6820-de7a-484b-a76f-cd05b1b0347d for instance cd8aead4-e4e9-4733-8351-1be87fd84dff on hv-cinder-84914 Sep 22 22:19:17.476639 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-b6c1a4a8-f9c3-494b-9703-5a76812acd1c req-c4fbe58a-1a64-498d-9986-37c43bfed238 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037016 Sep 22 22:19:17.478328 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 423/865] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:17.490230 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:17.491173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:17.497357 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:17.498036 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:17.498649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:17.499573 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:17.500018 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:17.500592 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:17.664622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:17.673249 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-56079c2a-6148-4255-b7a5-75fc5a2d530d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1364 microversion: 2.1 time: 0.279624 Sep 22 22:19:17.673980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 443/866] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:17 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:17.782879 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-e3b4bd6c-73cb-4fd3-adee-87111d22412a req-024baa8b-b108-4436-94a3-26533f62810d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03", "name": "network-vif-plugged", "status": "completed", "tag": "0442a6b6-83cd-4999-8bc7-27ce501c9b84"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:17.803652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e3b4bd6c-73cb-4fd3-adee-87111d22412a req-024baa8b-b108-4436-94a3-26533f62810d service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:17.804562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e3b4bd6c-73cb-4fd3-adee-87111d22412a req-024baa8b-b108-4436-94a3-26533f62810d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:17.805753 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-e3b4bd6c-73cb-4fd3-adee-87111d22412a req-024baa8b-b108-4436-94a3-26533f62810d service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:17.819914 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-e3b4bd6c-73cb-4fd3-adee-87111d22412a req-024baa8b-b108-4436-94a3-26533f62810d service nova] Creating event network-vif-plugged:0442a6b6-83cd-4999-8bc7-27ce501c9b84 for instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 on hv-cinder-84914 Sep 22 22:19:17.825556 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-e3b4bd6c-73cb-4fd3-adee-87111d22412a req-024baa8b-b108-4436-94a3-26533f62810d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046051 Sep 22 22:19:17.826650 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 444/867] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:18.009225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:18.017057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4b79e2e5-e593-45ef-bf8b-1922fea1349c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1366 microversion: 2.1 time: 0.531685 Sep 22 22:19:18.017676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 424/868] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:17 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1366 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:18.604751 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:18.605363 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:18.612519 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:18.613619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:18.614068 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:18.614770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:18.615224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:18.615827 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:18.698755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:18.699364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:18.705540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:18.706031 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:18.706467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:18.707561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:18.708173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:18.708600 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:18.728936 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lazy-loading 'services' on Instance uuid cd8aead4-e4e9-4733-8351-1be87fd84dff {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:19:18.832603 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24459dbf-f437-4f5b-b7c5-80c902a0bf3a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments/5688695b-89dd-420b-9551-f97fca368353" status: 202 len: 0 microversion: 2.1 time: 0.232326 Sep 22 22:19:18.837554 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 445/869] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:19:18 2022] DELETE /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments/5688695b-89dd-420b-9551-f97fca368353 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:19:18.856187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7bf303b8-410f-43b6-9e68-03fe75318fe5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:18.861298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7bf303b8-410f-43b6-9e68-03fe75318fe5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:18.868633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bf303b8-410f-43b6-9e68-03fe75318fe5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:18.869415 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bf303b8-410f-43b6-9e68-03fe75318fe5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:18.870027 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bf303b8-410f-43b6-9e68-03fe75318fe5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:18.870921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bf303b8-410f-43b6-9e68-03fe75318fe5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:18.871378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bf303b8-410f-43b6-9e68-03fe75318fe5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:18.871801 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7bf303b8-410f-43b6-9e68-03fe75318fe5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:18.904355 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7bf303b8-410f-43b6-9e68-03fe75318fe5 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055222 Sep 22 22:19:18.910579 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 446/870] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:19:18 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:18.916216 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:18.924291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e59bd616-4748-49a5-9dbd-b9501b46ec9a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1364 microversion: 2.1 time: 0.230184 Sep 22 22:19:18.924864 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 425/871] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:18 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:19.041895 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:19.042505 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:19.048351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:19.048832 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:19.049330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:19.050023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:19.051080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:19.051721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:19.184314 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:19.192245 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5d94dc8f-81e3-4cc9-9c35-83063be9b1c9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1366 microversion: 2.1 time: 0.154133 Sep 22 22:19:19.192822 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 447/872] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:19 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:19.492793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-496c9e89-637d-4e4e-a268-71c2520886cd req-240c4dbf-3cc8-4a52-9bab-3cc132e905a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8aead4-e4e9-4733-8351-1be87fd84dff", "tag": "ad1f6820-de7a-484b-a76f-cd05b1b0347d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:19.502611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=4 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:19.504605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=16 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:19.507130 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-496c9e89-637d-4e4e-a268-71c2520886cd req-240c4dbf-3cc8-4a52-9bab-3cc132e905a5 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:19.507645 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-496c9e89-637d-4e4e-a268-71c2520886cd req-240c4dbf-3cc8-4a52-9bab-3cc132e905a5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:19.508103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-496c9e89-637d-4e4e-a268-71c2520886cd req-240c4dbf-3cc8-4a52-9bab-3cc132e905a5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:19.521264 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-496c9e89-637d-4e4e-a268-71c2520886cd req-240c4dbf-3cc8-4a52-9bab-3cc132e905a5 service nova] Creating event network-changed:ad1f6820-de7a-484b-a76f-cd05b1b0347d for instance cd8aead4-e4e9-4733-8351-1be87fd84dff on hv-cinder-84914 Sep 22 22:19:19.533608 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-496c9e89-637d-4e4e-a268-71c2520886cd req-240c4dbf-3cc8-4a52-9bab-3cc132e905a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038305 Sep 22 22:19:19.534752 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 426/873] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:19.917710 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-aa530e97-f816-4457-ad6e-080b2f477982 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:19.919975 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-aa530e97-f816-4457-ad6e-080b2f477982 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:19.921986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=8 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:19.927793 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa530e97-f816-4457-ad6e-080b2f477982 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:19.928274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa530e97-f816-4457-ad6e-080b2f477982 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:19.928706 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa530e97-f816-4457-ad6e-080b2f477982 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:19.929425 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa530e97-f816-4457-ad6e-080b2f477982 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:19.929873 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa530e97-f816-4457-ad6e-080b2f477982 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:19.930291 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa530e97-f816-4457-ad6e-080b2f477982 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:19.948792 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:19.949773 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:19.956507 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:19.957970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:19.958619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:19.959361 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:19.959984 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:19.960581 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:19.961393 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-aa530e97-f816-4457-ad6e-080b2f477982 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047552 Sep 22 22:19:19.966775 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 448/874] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:19:19 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:20.096819 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:20.105611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-12760324-6751-42a8-82f5-8b7313bfa3c3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1364 microversion: 2.1 time: 0.160922 Sep 22 22:19:20.106198 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 427/875] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:19 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:20.215699 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:20.216507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:20.223636 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:20.224612 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:20.225395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:20.226311 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:20.226773 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:20.227200 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:20.369235 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:20.376691 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-85d3ccfb-7622-4c31-8b9a-4b9f6d91342c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1366 microversion: 2.1 time: 0.164755 Sep 22 22:19:20.377275 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 449/876] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:20 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:20.974580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c3b10932-d877-45ed-87b3-a51128c91e11 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:20.976703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c3b10932-d877-45ed-87b3-a51128c91e11 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:20.982994 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3b10932-d877-45ed-87b3-a51128c91e11 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:20.983465 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3b10932-d877-45ed-87b3-a51128c91e11 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:20.983894 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3b10932-d877-45ed-87b3-a51128c91e11 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:20.984577 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3b10932-d877-45ed-87b3-a51128c91e11 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:20.985023 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3b10932-d877-45ed-87b3-a51128c91e11 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:20.985468 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c3b10932-d877-45ed-87b3-a51128c91e11 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:21.016708 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c3b10932-d877-45ed-87b3-a51128c91e11 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046078 Sep 22 22:19:21.017506 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 428/877] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:19:20 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:21.127765 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:21.128374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:21.134967 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:21.135453 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:21.135888 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:21.136571 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:21.137023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:21.137473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:21.268260 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:21.276218 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-aa4a88d6-8c5f-483d-81bc-006089c214fb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1550 microversion: 2.1 time: 0.152305 Sep 22 22:19:21.276865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 450/878] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:21 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:21.299658 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-765d6b5f-bf9b-44db-9975-1c15752c3d65 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:21.300075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-765d6b5f-bf9b-44db-9975-1c15752c3d65 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:21.306987 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-765d6b5f-bf9b-44db-9975-1c15752c3d65 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:21.307480 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-765d6b5f-bf9b-44db-9975-1c15752c3d65 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:21.307919 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-765d6b5f-bf9b-44db-9975-1c15752c3d65 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:21.308613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-765d6b5f-bf9b-44db-9975-1c15752c3d65 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:21.309068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-765d6b5f-bf9b-44db-9975-1c15752c3d65 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:21.309521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-765d6b5f-bf9b-44db-9975-1c15752c3d65 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:21.335937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-d33e8a64-2f08-484a-b60f-79c4ffe61156 req-9e1efde9-b1a1-4c65-adcb-a61eb1353894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fabbba-5575-4388-a3e4-2927edcb7026", "name": "network-vif-plugged", "status": "completed", "tag": "14a75f4e-b63a-4d20-adaa-5a0575ec7510"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:21.345866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d33e8a64-2f08-484a-b60f-79c4ffe61156 req-9e1efde9-b1a1-4c65-adcb-a61eb1353894 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:21.346434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d33e8a64-2f08-484a-b60f-79c4ffe61156 req-9e1efde9-b1a1-4c65-adcb-a61eb1353894 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:21.346965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-d33e8a64-2f08-484a-b60f-79c4ffe61156 req-9e1efde9-b1a1-4c65-adcb-a61eb1353894 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:21.359083 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-d33e8a64-2f08-484a-b60f-79c4ffe61156 req-9e1efde9-b1a1-4c65-adcb-a61eb1353894 service nova] Creating event network-vif-plugged:14a75f4e-b63a-4d20-adaa-5a0575ec7510 for instance d1fabbba-5575-4388-a3e4-2927edcb7026 on hv-cinder-84914 Sep 22 22:19:21.364650 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-d33e8a64-2f08-484a-b60f-79c4ffe61156 req-9e1efde9-b1a1-4c65-adcb-a61eb1353894 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032511 Sep 22 22:19:21.365405 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 451/879] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:19:21.396916 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-765d6b5f-bf9b-44db-9975-1c15752c3d65 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101234 Sep 22 22:19:21.397689 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 429/880] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 22 22:19:21 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:19:21.400221 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:21.400915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:21.407300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:21.407795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:21.408234 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:21.408928 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:21.410471 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:21.410905 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:21.696470 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:21.704571 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1c6518f8-8541-4b7c-816e-7b340e328ba9 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1366 microversion: 2.1 time: 0.308434 Sep 22 22:19:21.705253 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 452/881] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:21 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:19:22.029959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ab63faf4-8aa8-438f-825b-f8032f93facf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:22.032122 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ab63faf4-8aa8-438f-825b-f8032f93facf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:22.040295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab63faf4-8aa8-438f-825b-f8032f93facf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:22.041036 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab63faf4-8aa8-438f-825b-f8032f93facf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:22.041755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab63faf4-8aa8-438f-825b-f8032f93facf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:22.042819 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab63faf4-8aa8-438f-825b-f8032f93facf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:22.043514 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab63faf4-8aa8-438f-825b-f8032f93facf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:22.044160 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ab63faf4-8aa8-438f-825b-f8032f93facf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:22.076992 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ab63faf4-8aa8-438f-825b-f8032f93facf tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051648 Sep 22 22:19:22.077609 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 430/882] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:19:22 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:22.728662 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:22.729413 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:22.736992 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:22.737592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:22.739072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:22.739901 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:22.740368 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:22.740799 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:22.938032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:22.945632 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2ae95e23-d259-4809-a1d0-c94688ae6b84 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1366 microversion: 2.1 time: 0.220933 Sep 22 22:19:22.946595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 453/883] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:22 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:23.043702 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-55e151c4-dcd0-45b1-ab54-ff3723d33231 req-2dbe247f-45ba-4a65-940f-296c7760f2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03", "tag": "0442a6b6-83cd-4999-8bc7-27ce501c9b84"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:23.053512 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-55e151c4-dcd0-45b1-ab54-ff3723d33231 req-2dbe247f-45ba-4a65-940f-296c7760f2c4 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:23.053989 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-55e151c4-dcd0-45b1-ab54-ff3723d33231 req-2dbe247f-45ba-4a65-940f-296c7760f2c4 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:23.055145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-55e151c4-dcd0-45b1-ab54-ff3723d33231 req-2dbe247f-45ba-4a65-940f-296c7760f2c4 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:23.067646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-55e151c4-dcd0-45b1-ab54-ff3723d33231 req-2dbe247f-45ba-4a65-940f-296c7760f2c4 service nova] Creating event network-changed:0442a6b6-83cd-4999-8bc7-27ce501c9b84 for instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 on hv-cinder-84914 Sep 22 22:19:23.072646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-55e151c4-dcd0-45b1-ab54-ff3723d33231 req-2dbe247f-45ba-4a65-940f-296c7760f2c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032751 Sep 22 22:19:23.073273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 431/884] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:23.089970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-478803e5-ed47-414d-8298-f0452802900a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:23.092120 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-478803e5-ed47-414d-8298-f0452802900a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:23.098678 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478803e5-ed47-414d-8298-f0452802900a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:23.099153 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478803e5-ed47-414d-8298-f0452802900a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:23.099586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478803e5-ed47-414d-8298-f0452802900a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:23.100279 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478803e5-ed47-414d-8298-f0452802900a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:23.100736 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478803e5-ed47-414d-8298-f0452802900a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:23.101182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-478803e5-ed47-414d-8298-f0452802900a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:23.104921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:23.130810 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-478803e5-ed47-414d-8298-f0452802900a tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044768 Sep 22 22:19:23.131382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 454/885] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:19:23 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 22:19:23.142585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:23.143272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:23.150417 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:23.150981 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:23.151418 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:23.152140 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:23.152592 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:23.153012 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:23.227930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] HTTP exception thrown: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff is not attached to volume 5688695b-89dd-420b-9551-f97fca368353 Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Request method failure captured: Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments/5688695b-89dd-420b-9551-f97fca368353 HTTP/1.1 Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN6YP0CnBL7_NhRaLAhSaRzD2S5DNW-Ojvu_kUXbwl6_foIYdcRTHFMIuJXTLx_9yXiuP9tfAnYlGWMzZabP1Jg-BIijHiZvTlVKEKZXjwwIQKUpNTPaY8R0dFkg8_vU3Q5QU9jP2iOW6NZ_6SSiIQez4uxIXmo_Nenn63UZ7fJf8eM Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 53f244703dfd4cb29d183025b9d6789e Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestMinimumBasicScenario-350163043 Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:19:23.230390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53f244703dfd4cb29d183025b9d6789e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53f244703dfd4cb29d183025b9d6789e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/53f244703dfd4cb29d183025b9d6789e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_53f244703dfd4cb29d183025b9d6789e", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestMinimumBasicScenario-350163043 Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 53f244703dfd4cb29d183025b9d6789e Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestMinimumBasicScenario-350163043 Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-TestMinimumBasicScenario-350163043-project Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 9e819ca5b7e446ff86dc6a47abd88105 Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestMinimumBasicScenario-350163043-project Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:19:23.232104 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff is not attached to volume 5688695b-89dd-420b-9551-f97fca368353 Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'server_id': 'cd8aead4-e4e9-4733-8351-1be87fd84dff', 'id': '5688695b-89dd-420b-9551-f97fca368353'} Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5688695b-89dd-420b-9551-f97fca368353. Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:19:23.233193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff is not attached to volume 5688695b-89dd-420b-9551-f97fca368353 Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff is not attached to volume 5688695b-89dd-420b-9551-f97fca368353 Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:19:23.234668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Returning 404 to user: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff is not attached to volume 5688695b-89dd-420b-9551-f97fca368353 {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:19:23.235984 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-28408ad6-b507-4c15-824c-54e9b3f6df16 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments/5688695b-89dd-420b-9551-f97fca368353" status: 404 len: 154 microversion: 2.1 time: 0.093547 Sep 22 22:19:23.235984 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 432/886] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:19:23 2022] DELETE /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff/os-volume_attachments/5688695b-89dd-420b-9551-f97fca368353 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:19:23.969506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:23.970263 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:23.976791 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:23.977344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:23.977792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:23.978529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:23.978988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:23.979414 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:24.122397 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:24.130194 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-23f80954-b6f1-431a-8663-4df02aef36d7 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1556 microversion: 2.1 time: 0.164598 Sep 22 22:19:24.130761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 455/887] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:23 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:24.152055 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-774820c9-ec17-4807-9c11-097047bdb645 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:24.152585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-774820c9-ec17-4807-9c11-097047bdb645 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:24.158928 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-774820c9-ec17-4807-9c11-097047bdb645 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:24.160207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-774820c9-ec17-4807-9c11-097047bdb645 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:24.160638 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-774820c9-ec17-4807-9c11-097047bdb645 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:24.161373 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-774820c9-ec17-4807-9c11-097047bdb645 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:24.161821 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-774820c9-ec17-4807-9c11-097047bdb645 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:24.162241 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-774820c9-ec17-4807-9c11-097047bdb645 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:24.311041 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-774820c9-ec17-4807-9c11-097047bdb645 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162801 Sep 22 22:19:24.311639 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 433/888] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 22 22:19:24 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:24.385709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:24.386456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:24.393004 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:24.393700 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:24.394595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:24.395594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:24.396207 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:24.396789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:24.424587 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:19:24.509457 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8d115432-1888-497e-8fd7-fd64f9f02ea6 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 204 len: 0 microversion: 2.1 time: 0.127798 Sep 22 22:19:24.510011 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 456/889] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:19:24 2022] DELETE /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:19:24.521063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:24.522984 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:24.538431 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:24.539202 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:24.539819 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:24.540741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:24.541998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:24.542427 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:24.561609 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=100 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:19:24.699896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:24.707955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a6320945-8b18-4d0e-b9d0-df42f729f90b tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1554 microversion: 2.1 time: 0.193660 Sep 22 22:19:24.721130 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 434/890] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:24 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1554 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:25.252911 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-9c3a7473-b907-4bd2-88ec-35f6b9a7f445 req-0d810f64-863e-4b30-a222-257b2f44a749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fabbba-5575-4388-a3e4-2927edcb7026", "tag": "14a75f4e-b63a-4d20-adaa-5a0575ec7510"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:25.262864 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9c3a7473-b907-4bd2-88ec-35f6b9a7f445 req-0d810f64-863e-4b30-a222-257b2f44a749 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:25.263418 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9c3a7473-b907-4bd2-88ec-35f6b9a7f445 req-0d810f64-863e-4b30-a222-257b2f44a749 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:25.263913 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9c3a7473-b907-4bd2-88ec-35f6b9a7f445 req-0d810f64-863e-4b30-a222-257b2f44a749 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:25.275460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-9c3a7473-b907-4bd2-88ec-35f6b9a7f445 req-0d810f64-863e-4b30-a222-257b2f44a749 service nova] Creating event network-changed:14a75f4e-b63a-4d20-adaa-5a0575ec7510 for instance d1fabbba-5575-4388-a3e4-2927edcb7026 on hv-cinder-84914 Sep 22 22:19:25.280374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-9c3a7473-b907-4bd2-88ec-35f6b9a7f445 req-0d810f64-863e-4b30-a222-257b2f44a749 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031448 Sep 22 22:19:25.280975 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 457/891] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:25.731868 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:25.732618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:25.739973 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:25.740458 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:25.740891 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:25.741613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:25.742069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:25.742490 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:25.875771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:25.883416 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-47793630-0899-44a5-bd69-37deb22a4851 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1554 microversion: 2.1 time: 0.155448 Sep 22 22:19:25.883985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 435/892] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:25 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:26.911959 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:26.913543 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:26.920593 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:26.921347 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:26.921830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:26.922553 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:26.923041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:26.923447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:27.139220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e819ca5b7e446ff86dc6a47abd88105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f244703dfd4cb29d183025b9d6789e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:19:27.148921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-80db5887-2429-4f37-8dee-34e4dfa61e79 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 200 len: 1554 microversion: 2.1 time: 0.245478 Sep 22 22:19:27.149901 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 458/893] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:26 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:19:27.318180 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-f1ce98ef-d970-4ce5-9ee3-41859b790982 req-19235b4f-8ef4-4fe5-81e6-4420da0b58a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8aead4-e4e9-4733-8351-1be87fd84dff", "name": "network-vif-deleted", "tag": "ad1f6820-de7a-484b-a76f-cd05b1b0347d"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:19:27.330114 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f1ce98ef-d970-4ce5-9ee3-41859b790982 req-19235b4f-8ef4-4fe5-81e6-4420da0b58a8 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:27.330588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f1ce98ef-d970-4ce5-9ee3-41859b790982 req-19235b4f-8ef4-4fe5-81e6-4420da0b58a8 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:27.331015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-f1ce98ef-d970-4ce5-9ee3-41859b790982 req-19235b4f-8ef4-4fe5-81e6-4420da0b58a8 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:27.344272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-f1ce98ef-d970-4ce5-9ee3-41859b790982 req-19235b4f-8ef4-4fe5-81e6-4420da0b58a8 service nova] Creating event network-vif-deleted:ad1f6820-de7a-484b-a76f-cd05b1b0347d for instance cd8aead4-e4e9-4733-8351-1be87fd84dff on hv-cinder-84914 Sep 22 22:19:27.349302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-f1ce98ef-d970-4ce5-9ee3-41859b790982 req-19235b4f-8ef4-4fe5-81e6-4420da0b58a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035444 Sep 22 22:19:27.349893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 436/894] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:19:28.173301 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:28.173910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] [instance: cd8aead4-e4e9-4733-8351-1be87fd84dff] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:19:28.180275 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:28.180755 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:28.181216 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:28.181902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:19:28.182350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:19:28.182773 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:19:28.195949 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] HTTP exception thrown: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff could not be found. Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Request method failure captured: Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff HTTP/1.1 Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN6YP0CnBL7_NhRaLAhSaRzD2S5DNW-Ojvu_kUXbwl6_foIYdcRTHFMIuJXTLx_9yXiuP9tfAnYlGWMzZabP1Jg-BIijHiZvTlVKEKZXjwwIQKUpNTPaY8R0dFkg8_vU3Q5QU9jP2iOW6NZ_6SSiIQez4uxIXmo_Nenn63UZ7fJf8eM Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 53f244703dfd4cb29d183025b9d6789e Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-TestMinimumBasicScenario-350163043 Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:19:28.197601 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53f244703dfd4cb29d183025b9d6789e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53f244703dfd4cb29d183025b9d6789e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/53f244703dfd4cb29d183025b9d6789e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_53f244703dfd4cb29d183025b9d6789e", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-TestMinimumBasicScenario-350163043 Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 53f244703dfd4cb29d183025b9d6789e Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-TestMinimumBasicScenario-350163043 Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-TestMinimumBasicScenario-350163043-project Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 9e819ca5b7e446ff86dc6a47abd88105 Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-TestMinimumBasicScenario-350163043-project Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff could not be found. Sep 22 22:19:28.199166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'cd8aead4-e4e9-4733-8351-1be87fd84dff'} Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff could not be found. Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:19:28.200073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff could not be found. Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff could not be found. Sep 22 22:19:28.201723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:19:28.203117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Returning 404 to user: Instance cd8aead4-e4e9-4733-8351-1be87fd84dff could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:19:28.203117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-04908cdb-8d81-4f79-96bb-b4b902e3c427 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff" status: 404 len: 111 microversion: 2.1 time: 0.029550 Sep 22 22:19:28.203117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 459/895] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:19:28 2022] GET /compute/v2.1/servers/cd8aead4-e4e9-4733-8351-1be87fd84dff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:19:28.208680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c82c5996-631b-460b-8d93-c93e317fc541 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] Calling method '.version_select at 0x7f405cfaad30>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:19:28.227676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c82c5996-631b-460b-8d93-c93e317fc541 tempest-TestMinimumBasicScenario-350163043 tempest-TestMinimumBasicScenario-350163043-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-266779907" status: 202 len: 0 microversion: 2.1 time: 0.023711 Sep 22 22:19:28.228284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 437/896] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Sep 22 22:19:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-266779907 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:20:08.899763 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b355861-d4ba-4903-a86e-84a65e6dc2d1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:08.900370 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7b355861-d4ba-4903-a86e-84a65e6dc2d1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:08.902659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:08.903301 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:08.910764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b355861-d4ba-4903-a86e-84a65e6dc2d1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:08.911239 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b355861-d4ba-4903-a86e-84a65e6dc2d1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:08.911675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b355861-d4ba-4903-a86e-84a65e6dc2d1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:08.912356 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b355861-d4ba-4903-a86e-84a65e6dc2d1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:08.912808 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b355861-d4ba-4903-a86e-84a65e6dc2d1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:08.913258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b355861-d4ba-4903-a86e-84a65e6dc2d1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:08.941413 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7b355861-d4ba-4903-a86e-84a65e6dc2d1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/ips" status: 200 len: 153 microversion: 2.20 time: 0.045617 Sep 22 22:20:08.941975 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 460/897] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Sep 22 22:20:08 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/ips => generated 153 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:20:10.808794 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:20:10.809475 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:10.811832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=10 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:10.812474 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:10.819315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:10.819803 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:10.820243 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:10.820940 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:10.821437 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:10.821865 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:10.846939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lazy-loading 'flavor' on Instance uuid 03073c72-a5ba-4bab-90eb-f92f0396c092 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:20:11.070101 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-00aa384f-7a5a-4739-aed6-ae12184fe9ea tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/action" status: 202 len: 0 microversion: 2.20 time: 0.264880 Sep 22 22:20:11.070698 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 438/898] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 22 22:20:10 2022] POST /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:20:11.078848 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:11.079635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:11.086460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:11.086972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:11.087406 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:11.088204 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:11.088852 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:11.089230 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:11.218351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:11.226882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:11.228338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:11.229511 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3b76566d-84be-4008-b184-8980bfb7bb48 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.154578 Sep 22 22:20:11.230061 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 461/899] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:11 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:12.262460 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:12.262460 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:12.265448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:12.265930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:12.266357 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:12.267705 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:12.268148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:12.268566 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:12.397845 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:12.405741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:12.407180 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:12.408856 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-50c6dbe8-61ad-406f-b808-249b6bae3b7e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.155763 Sep 22 22:20:12.409466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 439/900] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:12 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:13.434965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:13.435536 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:13.441551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:13.442032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:13.442464 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:13.443148 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:13.443597 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:13.444019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:13.786420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:13.794431 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:13.795870 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:13.797019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-13cd8f70-2d38-4dc5-b1d8-ae7fc9f42774 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.366251 Sep 22 22:20:13.797604 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 462/901] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:13 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:14.823042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:14.823766 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:14.831105 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:14.831693 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:14.832136 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:14.832837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:14.833331 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:14.833893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:15.021826 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:15.029888 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:15.031309 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:15.032452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-db53c80c-aec1-4a3d-85f0-ab2eaa452870 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.213264 Sep 22 22:20:15.033008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 440/902] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:14 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:16.058073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:16.058675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:16.065250 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:16.065739 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:16.066165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:16.066851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:16.067298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:16.067713 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:16.201439 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:16.210254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:16.211698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:16.212860 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-87456bd8-99fb-4e9b-b196-c9be66447143 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.158634 Sep 22 22:20:16.213448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 463/903] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:16 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:17.238918 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:17.239603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:17.245923 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:17.246400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:17.246830 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:17.247515 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:17.247962 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:17.248380 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:17.378297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:17.386222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:17.387650 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:17.388792 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-15994e74-5426-432f-9c45-32d5f6844c49 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.153836 Sep 22 22:20:17.389384 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 441/904] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:17 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:20:18.415949 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:18.416466 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:18.422781 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:18.423251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:18.423676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:18.424350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:18.424819 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:18.425270 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:18.556862 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:18.564868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:18.566489 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:18.567701 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b9dc6411-9d80-4793-8b17-7b5149d83d89 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.155664 Sep 22 22:20:18.568258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 464/905] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:18 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:19.593878 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:19.594447 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:19.601259 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:19.601745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:19.602179 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:19.602875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:19.603326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:19.603750 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:19.730605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:19.739315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:19.740749 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:19.741939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-30bab5fd-a6e8-4080-a19d-88622c7c94d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.152228 Sep 22 22:20:19.742501 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 442/906] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:19 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:20.767441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:20.768052 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:20.774746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:20.775253 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:20.775687 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:20.776378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:20.776833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:20.777290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:20.984234 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:20.992744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:20.994206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:20.995492 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fe04bae1-7c67-4337-ac45-2b6b9186d2dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.231964 Sep 22 22:20:20.996048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 465/907] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:20 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:22.022103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:22.022736 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:22.029266 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:22.029747 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:22.030179 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:22.030864 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:22.031316 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:22.031784 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:22.161642 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:22.169624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:22.171067 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:22.172261 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c154678a-546f-4ec9-9a39-d41857ed1269 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.154414 Sep 22 22:20:22.172818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 443/908] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:22 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:23.201913 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:23.202523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:23.209373 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:23.209861 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:23.210300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:23.210991 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:23.211449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:23.211874 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:23.341231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:23.349890 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:23.351332 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:23.352482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4fdeeed7-86ab-435d-bf78-925844a0b288 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.154469 Sep 22 22:20:23.353041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 466/909] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:23 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:24.378738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:24.379978 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:24.386199 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:24.386671 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:24.387098 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:24.387780 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:24.388226 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:24.388646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:24.519466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:24.527726 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:24.529168 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:24.530321 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a6bae227-5286-415f-96ff-4a0901f95e81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.155620 Sep 22 22:20:24.530881 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 444/910] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:24 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:25.554964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:25.555570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:25.562246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:25.562728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:25.563165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:25.563853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:25.564306 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:25.564730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:25.689605 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:25.698557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:25.700017 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:25.701210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-86ca0003-a822-4531-8cc9-a1e0d355b28e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.150351 Sep 22 22:20:25.701771 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 467/911] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:25 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:26.726804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:26.727413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:26.734043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:26.734514 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:26.734944 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:26.735619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:26.736064 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:26.736477 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:26.866805 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:26.874664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:26.876092 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:26.877284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-854ecc7e-e6a6-4f69-9410-a734feabfcb1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.155105 Sep 22 22:20:26.877843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 445/912] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:26 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:27.902646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:27.903235 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:27.909642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:27.910114 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:27.910538 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:27.911728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:27.912451 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:27.912848 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:28.039493 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:28.048021 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:28.049479 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:28.050621 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9aad5e8b-5c1b-43f2-888d-a608390239cc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1746 microversion: 2.20 time: 0.152083 Sep 22 22:20:28.051178 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 468/913] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:27 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:29.075829 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:29.076443 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:29.082830 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:29.083371 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:29.083858 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:29.084552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:29.085008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:29.085457 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:29.210678 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:29.218654 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:29.220106 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:29.221344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ce2ff9dd-f6f9-4de9-a20e-775160f911cd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1746 microversion: 2.20 time: 0.149364 Sep 22 22:20:29.221951 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 446/914] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:29 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:30.248838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:30.249526 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:30.258019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:30.258642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:30.259068 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:30.259781 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:30.260226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:30.260660 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:30.396074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:30.404090 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:30.405566 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:30.406720 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a1eae8ad-4c67-47f6-948b-34c8f5395fee tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1746 microversion: 2.20 time: 0.161941 Sep 22 22:20:30.407273 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 469/915] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:30 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:31.432354 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:31.432962 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:31.439395 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:31.439879 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:31.440315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:31.441005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:31.441489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:31.441916 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:31.568732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-9e8985f6-ff59-4b4e-81f3-fde43603bee3 req-1ff572de-fd0b-476a-9e9b-34d0f2b00821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03073c72-a5ba-4bab-90eb-f92f0396c092", "name": "network-vif-plugged", "status": "completed", "tag": "c8ece83a-0238-40e0-9d0d-3d28f90f9abf"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:20:31.578284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:31.581201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9e8985f6-ff59-4b4e-81f3-fde43603bee3 req-1ff572de-fd0b-476a-9e9b-34d0f2b00821 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:31.581789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9e8985f6-ff59-4b4e-81f3-fde43603bee3 req-1ff572de-fd0b-476a-9e9b-34d0f2b00821 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:31.582303 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-9e8985f6-ff59-4b4e-81f3-fde43603bee3 req-1ff572de-fd0b-476a-9e9b-34d0f2b00821 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:31.587361 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:31.589045 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:31.590432 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d479b347-4b6f-4e21-8f35-2c0bf9873714 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1746 microversion: 2.20 time: 0.161995 Sep 22 22:20:31.590992 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 447/916] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:31 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:31.594799 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-9e8985f6-ff59-4b4e-81f3-fde43603bee3 req-1ff572de-fd0b-476a-9e9b-34d0f2b00821 service nova] Creating event network-vif-plugged:c8ece83a-0238-40e0-9d0d-3d28f90f9abf for instance 03073c72-a5ba-4bab-90eb-f92f0396c092 on hv-cinder-84914 Sep 22 22:20:31.607433 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-9e8985f6-ff59-4b4e-81f3-fde43603bee3 req-1ff572de-fd0b-476a-9e9b-34d0f2b00821 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043159 Sep 22 22:20:31.608291 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 470/917] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:20:32.617095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:32.617719 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:32.624839 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:32.625358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:32.625783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:32.626466 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:32.626914 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:32.627331 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:32.757145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:32.765033 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:32.766487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:32.767641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a7113272-0d8f-44a9-97a1-61b68fadf923 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1746 microversion: 2.20 time: 0.154432 Sep 22 22:20:32.768194 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 448/918] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:32 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:33.795404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:33.796116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:33.802188 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:33.802664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:33.803812 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:33.804606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:33.805055 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:33.805506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:33.932638 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:33.940779 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:33.942253 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:33.943410 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e83e34fa-969f-406f-ab27-42772fee378c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1746 microversion: 2.20 time: 0.152761 Sep 22 22:20:33.944359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 471/919] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:33 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:34.969711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:34.970282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:34.976799 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:34.977536 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:34.978129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:34.979062 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:34.979677 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:34.980285 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:35.126864 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:35.138720 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:35.140356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:35.141837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7cbc340c-0f00-4c74-9e61-db032dd2a8b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1741 microversion: 2.20 time: 0.177287 Sep 22 22:20:35.142399 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 449/920] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:34 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:36.168815 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:36.169677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:36.176610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:36.177166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:36.177619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:36.178322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:36.178982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:36.179619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:36.334063 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:36.345854 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:36.348160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:36.349424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24c423db-008f-430a-ae8f-6ffdbe7e7abf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1741 microversion: 2.20 time: 0.184981 Sep 22 22:20:36.368119 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 472/921] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:36 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:20:37.377689 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:37.380110 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:37.388804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:37.389580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:37.390007 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:37.390705 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:37.391148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:37.391756 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:37.539143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:37.548311 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:37.549814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:37.551052 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b16b39d8-569f-49d3-88a8-d07dfcac4e6f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1741 microversion: 2.20 time: 0.177970 Sep 22 22:20:37.551636 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 450/922] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:37 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:38.584830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:38.586273 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:38.592642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:38.593122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:38.593586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:38.594269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:38.594718 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:38.595151 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:38.753828 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:38.763040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:38.764495 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:38.765692 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a82f01d4-2974-495c-8398-586dc2fab107 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1741 microversion: 2.20 time: 0.185140 Sep 22 22:20:38.766249 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 473/923] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:38 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:39.794436 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:39.795220 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:39.805229 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:39.805972 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:39.806405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:39.807110 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:39.807552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:39.807975 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:39.960597 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:39.979171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:39.981023 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:39.982282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-936309e4-3125-41fa-bc6c-f41924421add tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1741 microversion: 2.20 time: 0.193960 Sep 22 22:20:39.982859 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 451/924] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:39 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:41.009910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:41.011178 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:41.013700 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=29 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:41.020222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:41.020222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:41.020222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:41.020609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:41.021098 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:41.021621 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:41.025702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=79 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:41.173716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:41.183085 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:41.184549 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:41.185731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a5695104-6d74-418c-93fb-4184dd36f66b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1741 microversion: 2.20 time: 0.179820 Sep 22 22:20:41.197243 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 474/925] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:41 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:42.213832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:42.214553 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:42.216968 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=29 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:42.223809 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:42.224406 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:42.224918 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:42.226867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:42.227472 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:42.228031 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:42.230912 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:42.373853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:42.382496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:42.384811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:42.386163 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-19238e9f-fff0-43fc-907e-a83e644f14a5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1741 microversion: 2.20 time: 0.178182 Sep 22 22:20:42.401456 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 452/926] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:42 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:43.412264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:43.412842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:43.419476 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:43.419965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:43.420395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:43.421120 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:43.421573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:43.422034 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:43.587967 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:43.596682 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:43.598324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:43.599487 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-24fabd31-44b4-4a57-aaa6-14e95038c83b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1741 microversion: 2.20 time: 0.191424 Sep 22 22:20:43.602336 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 475/927] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:43 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:44.625895 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:44.626486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:44.633042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:44.633653 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:44.634178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:44.634874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:44.635325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:44.635745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:44.766690 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:44.775618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:44.777058 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:44.778240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-31b77ea1-d1cd-4a6f-9d1d-6028db45e83f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1741 microversion: 2.20 time: 0.156282 Sep 22 22:20:44.778797 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 453/928] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:44 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:45.805078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:45.806374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:45.812782 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:45.813287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:45.813718 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:45.814398 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:45.814847 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:45.815269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:45.944963 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:45.953489 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:45.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:45.956093 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c3675bbe-303d-4f98-9de6-4160053551fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1723 microversion: 2.20 time: 0.154922 Sep 22 22:20:45.956659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 476/929] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:45 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:46.982985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:46.983587 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:46.990159 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:46.990641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:46.991076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:46.991775 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:46.992245 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:46.992657 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:47.126994 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:47.135321 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:47.136742 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:47.137911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8314d60d-2675-4cf9-ada5-8a8b82196d9b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1723 microversion: 2.20 time: 0.158904 Sep 22 22:20:47.138476 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 454/930] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:46 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:47.593595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-4b3b20b9-fbc3-46ee-b44b-d80001a80b10 req-1ef080c8-0310-4109-b92b-0b0f5a13bda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03073c72-a5ba-4bab-90eb-f92f0396c092", "name": "network-vif-unplugged", "status": "completed", "tag": "c8ece83a-0238-40e0-9d0d-3d28f90f9abf"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:20:47.604843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4b3b20b9-fbc3-46ee-b44b-d80001a80b10 req-1ef080c8-0310-4109-b92b-0b0f5a13bda6 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:47.605457 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4b3b20b9-fbc3-46ee-b44b-d80001a80b10 req-1ef080c8-0310-4109-b92b-0b0f5a13bda6 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:47.605806 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-4b3b20b9-fbc3-46ee-b44b-d80001a80b10 req-1ef080c8-0310-4109-b92b-0b0f5a13bda6 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:47.769700 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-4b3b20b9-fbc3-46ee-b44b-d80001a80b10 req-1ef080c8-0310-4109-b92b-0b0f5a13bda6 service nova] Creating event network-vif-unplugged:c8ece83a-0238-40e0-9d0d-3d28f90f9abf for instance 03073c72-a5ba-4bab-90eb-f92f0396c092 on hv-cinder-84914 Sep 22 22:20:47.774819 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-4b3b20b9-fbc3-46ee-b44b-d80001a80b10 req-1ef080c8-0310-4109-b92b-0b0f5a13bda6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.185238 Sep 22 22:20:47.775575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 477/931] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:20:48.162703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:48.163308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:48.170755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:48.171232 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:48.171664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:48.172344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:48.172793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:48.173244 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:48.304968 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:48.313985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:48.315354 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:48.316496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3c458e02-9736-424e-980c-af4f07b12725 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1666 microversion: 2.20 time: 0.157689 Sep 22 22:20:48.317052 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 455/932] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:48 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:48.342113 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-46f9174c-bdb8-47a5-bb6b-3eb14d9b95e4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5372d210-1843-4f5b-b08a-901bbf8b8a9d"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:20:48.344443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-46f9174c-bdb8-47a5-bb6b-3eb14d9b95e4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:48.350999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f9174c-bdb8-47a5-bb6b-3eb14d9b95e4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:48.351478 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f9174c-bdb8-47a5-bb6b-3eb14d9b95e4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:48.351903 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f9174c-bdb8-47a5-bb6b-3eb14d9b95e4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:48.352581 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f9174c-bdb8-47a5-bb6b-3eb14d9b95e4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:48.353578 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f9174c-bdb8-47a5-bb6b-3eb14d9b95e4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:48.353995 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-46f9174c-bdb8-47a5-bb6b-3eb14d9b95e4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:48.627292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-46f9174c-bdb8-47a5-bb6b-3eb14d9b95e4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289369 Sep 22 22:20:48.627910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 478/933] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Sep 22 22:20:48 2022] POST /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:20:48.750550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:20:48.751144 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:48.756926 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:48.757448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:48.757881 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:48.758567 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:48.759528 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:48.759978 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:48.844913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120662) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 22:20:48.913071 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a9acf879-707a-4bdf-8d02-741330f8b0c2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/action" status: 202 len: 0 microversion: 2.20 time: 0.166354 Sep 22 22:20:48.916886 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 456/934] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 22 22:20:48 2022] POST /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:20:48.922311 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:48.922999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:48.929316 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:48.929799 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:48.930229 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:48.931237 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:48.931655 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:48.932084 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:49.069851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:49.079758 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:49.081232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:49.082445 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7128b412-6c86-4c8a-bae4-3bb1c5e70453 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1752 microversion: 2.20 time: 0.163998 Sep 22 22:20:49.083009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 479/935] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:48 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:50.109333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:50.109993 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:50.116076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:50.116874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:50.117400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:50.118282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:50.118949 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:50.119467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:50.257391 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:50.266604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:50.268043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:50.269248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2fea8260-46ac-4e06-9840-c6ed69ae8b6a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1752 microversion: 2.20 time: 0.164402 Sep 22 22:20:50.269807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 457/936] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:50 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:50.872490 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11cfec85-d0bf-4399-b2d9-658b349bef93 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:50.872994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-11cfec85-d0bf-4399-b2d9-658b349bef93 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:50.879464 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11cfec85-d0bf-4399-b2d9-658b349bef93 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:50.879945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11cfec85-d0bf-4399-b2d9-658b349bef93 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:50.880375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11cfec85-d0bf-4399-b2d9-658b349bef93 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:50.881060 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11cfec85-d0bf-4399-b2d9-658b349bef93 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:50.881557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11cfec85-d0bf-4399-b2d9-658b349bef93 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:50.881973 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11cfec85-d0bf-4399-b2d9-658b349bef93 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:50.906539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11cfec85-d0bf-4399-b2d9-658b349bef93 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/ips" status: 200 len: 146 microversion: 2.1 time: 0.037886 Sep 22 22:20:50.907100 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 480/937] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:20:50 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:20:51.301272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:51.301835 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:51.308151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:51.308690 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:51.309148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:51.310469 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:51.311025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:51.311452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:51.439822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:51.448299 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:51.449782 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:51.451538 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7a88ab45-9e87-4f39-8666-abc09a18194c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.154425 Sep 22 22:20:51.452097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 458/938] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:51 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:52.259724 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e4819be5-8992-4c8a-8240-c9752082858b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13888e08-6721-4a3f-a26b-7747be0e8dfa"}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:20:52.262199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e4819be5-8992-4c8a-8240-c9752082858b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:52.269256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4819be5-8992-4c8a-8240-c9752082858b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:52.269744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4819be5-8992-4c8a-8240-c9752082858b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:52.270182 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4819be5-8992-4c8a-8240-c9752082858b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:52.270868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4819be5-8992-4c8a-8240-c9752082858b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:52.271323 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4819be5-8992-4c8a-8240-c9752082858b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:52.271746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e4819be5-8992-4c8a-8240-c9752082858b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:52.477392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:52.478002 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:52.484683 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:52.485190 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:52.485656 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:52.486376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:52.486842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:52.487261 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:52.639234 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:52.649506 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:52.651065 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:52.652210 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-07b482ef-c58a-4415-8ff7-de7427443d7d tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.178715 Sep 22 22:20:52.652747 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 459/939] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:52 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:20:52.675486 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e4819be5-8992-4c8a-8240-c9752082858b tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419501 Sep 22 22:20:52.676443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 481/940] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:20:52 2022] POST /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:20:53.070566 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e2c7800f-c333-4acb-b098-bb732083fb66 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:53.071533 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e2c7800f-c333-4acb-b098-bb732083fb66 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:53.079333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2c7800f-c333-4acb-b098-bb732083fb66 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:53.080151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2c7800f-c333-4acb-b098-bb732083fb66 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:53.080785 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2c7800f-c333-4acb-b098-bb732083fb66 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:53.081874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2c7800f-c333-4acb-b098-bb732083fb66 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:53.082529 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2c7800f-c333-4acb-b098-bb732083fb66 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:53.083185 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e2c7800f-c333-4acb-b098-bb732083fb66 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:53.110133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e2c7800f-c333-4acb-b098-bb732083fb66 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/ips" status: 200 len: 150 microversion: 2.1 time: 0.217883 Sep 22 22:20:53.110818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 460/941] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 22 22:20:52 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/ips => generated 150 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:20:53.680722 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:53.682202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:53.689205 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:53.689723 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:53.690160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:53.692963 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:53.693483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:53.693915 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:53.842860 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:53.854574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:53.855997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:53.857225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eb26bcd5-f903-40df-ba81-68d4cc9c3d81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.181769 Sep 22 22:20:53.857785 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 482/942] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:53 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:20:54.501955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9f4a8fdb-4fe2-4293-952f-7fd3e2f8d46c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "815e2c88-9476-45a4-9b19-46b11f4da2f1"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:20:54.504478 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9f4a8fdb-4fe2-4293-952f-7fd3e2f8d46c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:54.512521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4a8fdb-4fe2-4293-952f-7fd3e2f8d46c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:54.514218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4a8fdb-4fe2-4293-952f-7fd3e2f8d46c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:54.514932 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4a8fdb-4fe2-4293-952f-7fd3e2f8d46c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:54.515832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4a8fdb-4fe2-4293-952f-7fd3e2f8d46c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:54.516331 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4a8fdb-4fe2-4293-952f-7fd3e2f8d46c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:54.517536 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9f4a8fdb-4fe2-4293-952f-7fd3e2f8d46c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:54.882877 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:54.884328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:54.891430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:54.891997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:54.892535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:54.893337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:54.893866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:54.894404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:55.035726 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:55.045528 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:55.046970 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:55.048174 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b5791c12-3b2c-4db7-b817-6124145c13d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.169324 Sep 22 22:20:55.048728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 483/943] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:54 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:20:56.074715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:56.075424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:56.082595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:56.083082 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:56.083519 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:56.084214 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:56.084674 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:56.085168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:56.223193 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:56.232516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:56.234152 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:56.235386 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-459a0922-3d0a-40a8-9fe2-6a91269d49cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.164619 Sep 22 22:20:56.235955 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 484/944] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:56 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:20:57.261869 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:57.263731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:57.270986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:57.271775 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:57.272385 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:57.273649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:57.274107 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:57.274535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:57.412977 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:57.423022 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:57.424814 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:57.426379 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8a521bf9-daad-4917-8a7e-325d1e555018 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.168671 Sep 22 22:20:57.426933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 485/945] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:57 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:20:58.453485 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:58.454128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:58.460446 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:58.460929 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:58.461388 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:58.462081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:58.462530 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:58.462951 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:58.601525 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:58.610619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:58.612267 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:58.613595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-28bb05c2-db83-4d2f-917d-99d618ae5981 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.164634 Sep 22 22:20:58.615987 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 486/946] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:58 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:20:59.641442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:20:59.642926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:20:59.649344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:59.649923 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:59.650424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:59.651198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:20:59.651736 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:20:59.652225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:20:59.838322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:59.844054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:20:59.857286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:59.859953 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:20:59.861399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9ff99f7b-ba00-4860-8f61-1fcba47f5eb8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.225371 Sep 22 22:20:59.877735 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 487/947] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:20:59 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:21:00.888166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:00.890794 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:00.897770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:00.898338 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:00.898761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:00.899511 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:00.899993 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:00.900572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:01.045148 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:01.054307 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:01.055922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:01.057206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e0ecca2f-dc0a-4901-8c00-6ba94e3f8779 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.173032 Sep 22 22:21:01.057862 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 488/948] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:00 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:02.083349 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:02.084069 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:02.090487 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:02.090964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:02.091418 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:02.092099 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:02.092561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:02.092988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:02.221554 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:02.230120 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:02.231552 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:02.232705 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0f59b7a1-59c1-4833-a988-d3625062242f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.153290 Sep 22 22:21:02.233335 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 489/949] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:02 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:21:03.258768 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:03.259454 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:03.266991 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:03.267474 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:03.268019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:03.268715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:03.269199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:03.269698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:03.418467 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:03.428854 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:03.430366 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:03.431551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8a27ef75-f344-4691-9a69-93478ca2c0b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.176913 Sep 22 22:21:03.432215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 490/950] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:03 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:21:04.459751 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:04.460358 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:04.466873 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:04.467355 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:04.467788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:04.468511 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:04.469056 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:04.469531 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:04.509077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:04.595020 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:04.597666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:04.606372 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:04.607812 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:04.609081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4f1f4cee-7152-4d7d-9fe3-50e0a1a21dc1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.153330 Sep 22 22:21:04.609665 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 491/951] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:04 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:21:05.635147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:05.635789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:05.642588 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:05.643061 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:05.643490 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:05.644166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:05.644615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:05.645035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:05.772261 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:05.782289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:05.783738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:05.784925 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5b0e3c57-8263-4efc-af9a-dd4f64475b71 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.153687 Sep 22 22:21:05.785521 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 492/952] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:05 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:21:06.370638 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9f4a8fdb-4fe2-4293-952f-7fd3e2f8d46c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "POST /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.873080 Sep 22 22:21:06.371392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 461/953] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:20:54 2022] POST /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 194 bytes in 11875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:06.811259 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:06.811870 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:06.818983 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:06.819477 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:06.819912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:06.820594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:06.821051 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:06.821507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:06.957516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:06.966106 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:06.967548 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:06.968946 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7dd94859-f7ad-403d-ae2f-878ccb3d6258 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.161620 Sep 22 22:21:06.969535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 493/954] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:06 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:21:07.994824 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:07.995525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:08.002215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:08.002703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:08.003136 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:08.003830 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:08.004285 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:08.004711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:08.139341 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:08.148795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:08.150271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:08.151447 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-976c6a44-1d55-4c67-9711-80c886501e28 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.160904 Sep 22 22:21:08.152271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 462/955] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:07 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:09.178290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:09.178802 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:09.185275 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:09.185758 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:09.186188 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:09.186877 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:09.187330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:09.187761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:09.320608 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:09.329892 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:09.331330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:09.332495 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8d44db0e-22f6-4b73-8ebe-14abd2fae87b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.158244 Sep 22 22:21:09.333048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 494/956] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:09 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:10.358469 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:10.359081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:10.366084 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:10.366568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:10.367001 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:10.367691 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:10.368145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:10.368565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:10.651902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:10.661037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:10.662573 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:10.663702 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-18b937b2-710f-4f14-bd8f-8e8f2c3f9955 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.309135 Sep 22 22:21:10.664245 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 463/957] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:10 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:11.690070 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:11.690674 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:11.692965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=42 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:11.698525 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:11.699014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:11.699472 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:11.700168 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:11.700617 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:11.701035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:11.828415 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:11.838851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:11.840327 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:11.841529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-64e7a6b7-4332-4f5f-a10c-5a8c1f4ae8c4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.155447 Sep 22 22:21:11.842142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 495/958] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:11 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:12.867687 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:12.868422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:12.874682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:12.875161 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:12.875594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:12.876797 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:12.877282 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:12.877706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:13.009438 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:13.018549 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:13.019981 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:13.021152 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-46729e1d-bfca-481b-8247-609ce546fb76 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.157292 Sep 22 22:21:13.021703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 464/959] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:12 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:13.224646 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1307259276", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1122905243", "security_groups": [{"name": "tempest-secgroup-smoke-67558175"}], "block_device_mapping_v2": [{"uuid": "66d6627c-5b01-45cd-8639-4653bde41a70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c773c61e-e7b7-47c6-998a-83ddea69af57"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:21:13.338273 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] validate_networks() for [('c773c61e-e7b7-47c6-998a-83ddea69af57', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:21:13.710969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:21:13.711395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:21:13.711866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:21:13.712274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:21:13.712686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:21:13.722049 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:13.722531 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:13.722968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:13.723690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:13.724145 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:13.724569 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:13.741483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Getting quotas for project e9c311fa04f241249d428df8e88539f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:21:13.745422 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Getting quotas for user cc89baeb82444da78312c4b0b3fb0c41 and project e9c311fa04f241249d428df8e88539f4. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:21:13.802390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:21:13.804529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66d6627c-5b01-45cd-8639-4653bde41a70',volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:21:13.934267 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-870ad030-94c8-4ccb-9c6b-9bf460d87b6e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.713421 Sep 22 22:21:13.934912 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 496/960] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:21:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:21:13.945576 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-19c09249-e3a8-463c-a5c0-d2768662ab28 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:13.946191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-19c09249-e3a8-463c-a5c0-d2768662ab28 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:14.009185 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-19c09249-e3a8-463c-a5c0-d2768662ab28 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:14.016156 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-19c09249-e3a8-463c-a5c0-d2768662ab28 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1095 microversion: 2.1 time: 0.074191 Sep 22 22:21:14.017252 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 465/961] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:13 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:14.046628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:14.047262 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:14.056117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:14.056117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:14.056117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:14.056117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:14.056517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:14.056517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:14.198236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:14.207331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:14.208757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:14.209977 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d2a00374-7c49-4792-9142-8e9c7f6f8627 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.167301 Sep 22 22:21:14.210510 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 497/962] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:14 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:15.039455 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:15.040063 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:15.047136 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:15.047610 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:15.048324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:15.049007 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:15.049486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:15.049900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:15.114657 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:15.123173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-582a587b-ec6a-4a97-834c-da0fdfb070a9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1145 microversion: 2.1 time: 0.087574 Sep 22 22:21:15.138754 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 466/963] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:15 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:15.237122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:15.237764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:15.244224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:15.244711 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:15.245180 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:15.245880 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:15.246342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:15.246771 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:15.377388 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:15.386040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:15.387514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:15.388670 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8e4430f6-1083-4789-ac07-2fa4671b66e7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.155537 Sep 22 22:21:15.389498 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 498/964] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:15 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:16.146357 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:16.147565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:16.153998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:16.154478 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:16.154963 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:16.155581 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:16.156127 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:16.156546 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:16.181291 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5d575b5-65c9-4ffd-bec1-c7254a39cccb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:16.183635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b5d575b5-65c9-4ffd-bec1-c7254a39cccb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:16.190531 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d575b5-65c9-4ffd-bec1-c7254a39cccb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:16.191022 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d575b5-65c9-4ffd-bec1-c7254a39cccb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:16.191465 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d575b5-65c9-4ffd-bec1-c7254a39cccb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:16.192170 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d575b5-65c9-4ffd-bec1-c7254a39cccb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:16.192629 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d575b5-65c9-4ffd-bec1-c7254a39cccb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:16.193055 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5d575b5-65c9-4ffd-bec1-c7254a39cccb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:16.226556 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b5d575b5-65c9-4ffd-bec1-c7254a39cccb tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049052 Sep 22 22:21:16.227329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 499/965] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:16 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:21:16.228814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:16.239002 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d0e7751f-6ad2-4d66-9fd6-89fc27032d48 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1193 microversion: 2.1 time: 0.095783 Sep 22 22:21:16.239852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 467/966] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:16 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:21:16.241617 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eefbb0e0-f6d4-467f-a1b1-e78a6fb69c72 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:16.242638 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eefbb0e0-f6d4-467f-a1b1-e78a6fb69c72 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:16.249978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefbb0e0-f6d4-467f-a1b1-e78a6fb69c72 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:16.250471 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefbb0e0-f6d4-467f-a1b1-e78a6fb69c72 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:16.250909 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefbb0e0-f6d4-467f-a1b1-e78a6fb69c72 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:16.252718 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefbb0e0-f6d4-467f-a1b1-e78a6fb69c72 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:16.253359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefbb0e0-f6d4-467f-a1b1-e78a6fb69c72 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:16.253781 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eefbb0e0-f6d4-467f-a1b1-e78a6fb69c72 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:16.294857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eefbb0e0-f6d4-467f-a1b1-e78a6fb69c72 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/13888e08-6721-4a3f-a26b-7747be0e8dfa" status: 200 len: 194 microversion: 2.1 time: 0.060816 Sep 22 22:21:16.301916 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 500/967] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Sep 22 22:21:16 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/13888e08-6721-4a3f-a26b-7747be0e8dfa => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:21:16.414176 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:16.414779 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:16.420797 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:16.421315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:16.421745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:16.422720 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:16.424278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:16.424697 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:16.675338 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:16.684119 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:16.685598 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:16.686755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4e50d2ff-f8a7-44c2-b325-7ddf287dd743 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.276543 Sep 22 22:21:16.687309 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 468/968] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:16 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:17.268178 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:17.269149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:17.276026 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:17.276539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:17.276976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:17.277739 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:17.278189 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:17.278815 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:17.534277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:17.547505 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e9f3b350-da38-4aa4-9ce1-6e4658d5a16c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1277 microversion: 2.1 time: 0.285180 Sep 22 22:21:17.548083 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 501/969] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:17 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:17.708358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bd7b97e1-514e-461d-b875-0d901eee7fc5 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1aa933e-63c1-4af8-8c42-ed7644c67d0d"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:21:17.711772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bd7b97e1-514e-461d-b875-0d901eee7fc5 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:17.727927 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:17.731958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd7b97e1-514e-461d-b875-0d901eee7fc5 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:17.732721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:17.735528 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd7b97e1-514e-461d-b875-0d901eee7fc5 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:17.736190 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd7b97e1-514e-461d-b875-0d901eee7fc5 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:17.737085 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd7b97e1-514e-461d-b875-0d901eee7fc5 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:17.737579 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd7b97e1-514e-461d-b875-0d901eee7fc5 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:17.741740 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd7b97e1-514e-461d-b875-0d901eee7fc5 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:17.746932 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:17.747432 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:17.747872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:17.748585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:17.749042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:17.750230 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:17.977206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:17.991029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:17.993483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:17.995031 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c31e05f4-70b3-46b3-beb0-76cd649a6957 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.280319 Sep 22 22:21:17.996212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 502/970] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:17 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:18.000945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-774e16a3-3227-4a6f-b7be-c43fd11aad8e req-2c4b83c1-ad70-480f-a3cc-f01341baf785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03073c72-a5ba-4bab-90eb-f92f0396c092", "name": "network-vif-plugged", "status": "completed", "tag": "c8ece83a-0238-40e0-9d0d-3d28f90f9abf"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:21:18.012481 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-774e16a3-3227-4a6f-b7be-c43fd11aad8e req-2c4b83c1-ad70-480f-a3cc-f01341baf785 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:18.013247 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-774e16a3-3227-4a6f-b7be-c43fd11aad8e req-2c4b83c1-ad70-480f-a3cc-f01341baf785 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:18.013853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-774e16a3-3227-4a6f-b7be-c43fd11aad8e req-2c4b83c1-ad70-480f-a3cc-f01341baf785 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:18.026595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-774e16a3-3227-4a6f-b7be-c43fd11aad8e req-2c4b83c1-ad70-480f-a3cc-f01341baf785 service nova] Creating event network-vif-plugged:c8ece83a-0238-40e0-9d0d-3d28f90f9abf for instance 03073c72-a5ba-4bab-90eb-f92f0396c092 on hv-cinder-84914 Sep 22 22:21:18.035091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-774e16a3-3227-4a6f-b7be-c43fd11aad8e req-2c4b83c1-ad70-480f-a3cc-f01341baf785 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037001 Sep 22 22:21:18.040179 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 503/971] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:18.075616 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bd7b97e1-514e-461d-b875-0d901eee7fc5 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "POST /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372833 Sep 22 22:21:18.076479 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 469/972] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 22 22:21:17 2022] POST /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:18.162240 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-99983b42-a2c1-4525-bd93-e89e65c8bc24 req-31663343-9681-4b05-bc34-e294bb894912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2feb92db-975d-4abf-8814-603da11f8603", "tag": "2f531c40-7605-4ab0-bed8-8a0000e6cd28"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:21:18.171878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-99983b42-a2c1-4525-bd93-e89e65c8bc24 req-31663343-9681-4b05-bc34-e294bb894912 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:18.172359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-99983b42-a2c1-4525-bd93-e89e65c8bc24 req-31663343-9681-4b05-bc34-e294bb894912 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:18.172794 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-99983b42-a2c1-4525-bd93-e89e65c8bc24 req-31663343-9681-4b05-bc34-e294bb894912 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:18.184088 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-99983b42-a2c1-4525-bd93-e89e65c8bc24 req-31663343-9681-4b05-bc34-e294bb894912 service nova] Creating event network-changed:2f531c40-7605-4ab0-bed8-8a0000e6cd28 for instance 2feb92db-975d-4abf-8814-603da11f8603 on hv-cinder-84914 Sep 22 22:21:18.188797 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-99983b42-a2c1-4525-bd93-e89e65c8bc24 req-31663343-9681-4b05-bc34-e294bb894912 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134909 Sep 22 22:21:18.189439 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 504/973] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:21:18.572371 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:18.573231 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:18.587559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:18.588041 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:18.588606 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:18.589346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:18.589807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:18.590235 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:18.778486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:18.786397 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ad852875-f592-4bf2-acfc-90ae72a746d7 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1277 microversion: 2.1 time: 0.218642 Sep 22 22:21:18.786952 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 470/974] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:18 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:19.023795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:19.024496 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:19.030653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:19.031135 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:19.031607 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:19.032292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:19.032749 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:19.033718 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:19.166697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:19.178269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:19.179719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:19.180900 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8d561939-d67c-4df5-8859-701250f234fd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.161925 Sep 22 22:21:19.181488 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 505/975] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:19 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:19.808764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:19.809410 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:19.816472 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:19.816954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:19.817413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:19.818097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:19.818550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:19.818970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:20.023905 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:20.031641 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1152e6e2-e3b6-472e-bb35-44bff1f9a3b8 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1277 microversion: 2.1 time: 0.226663 Sep 22 22:21:20.032203 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 471/976] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:19 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:20.207271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:20.207879 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:20.215274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:20.215806 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:20.216322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:20.217029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:20.217507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:20.218017 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:20.234497 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=100 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:20.351722 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:20.360245 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:20.361778 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:20.362933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b4f71a51-3c55-43d8-b38a-f2d6cc2ebdac tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1810 microversion: 2.20 time: 0.160490 Sep 22 22:21:20.363483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 506/977] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:20 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:21.056178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:21.057469 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:21.064541 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:21.065073 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:21.065597 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:21.066315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:21.066776 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:21.067205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:21.283888 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:21.292797 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f3a7e745-20f2-431f-99e7-3cfd8f3e2091 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1277 microversion: 2.1 time: 0.241271 Sep 22 22:21:21.305294 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 472/978] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:21 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:21.388782 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:21.389482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:21.397125 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:21.397654 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:21.398096 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:21.398837 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:21.399316 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:21.399763 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:21.547685 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:21.556579 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:21.558032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:21.559197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-63987f6c-ed5d-4fc5-a268-164043ac54d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1797 microversion: 2.20 time: 0.175334 Sep 22 22:21:21.559758 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 507/979] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:21:21 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1797 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:21:22.320773 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:22.321349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:22.328400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:22.328895 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:22.329373 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:22.330077 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:22.330653 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:22.331090 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:22.796195 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:22.805513 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7fc65195-d4de-4db0-80b3-c245a827d470 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1277 microversion: 2.1 time: 0.488682 Sep 22 22:21:22.806095 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 473/980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:22 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1277 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:23.652797 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:23.653322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:23.660377 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:23.660866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:23.661415 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:23.662115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:23.662573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:23.663001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:23.731840 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:23.743443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lazy-loading 'services' on Instance uuid d1fabbba-5575-4388-a3e4-2927edcb7026 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:21:23.755814 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:23.816515 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-838cc9ad-878d-4488-9f81-561c2229fd19 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments/815e2c88-9476-45a4-9b19-46b11f4da2f1" status: 202 len: 0 microversion: 2.1 time: 0.167397 Sep 22 22:21:23.817092 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 508/981] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:21:23 2022] DELETE /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments/815e2c88-9476-45a4-9b19-46b11f4da2f1 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:21:23.825408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a059d531-ecda-4b55-941c-040b9b56dd9a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:23.827626 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a059d531-ecda-4b55-941c-040b9b56dd9a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:23.828284 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:23.828985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:23.834823 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a059d531-ecda-4b55-941c-040b9b56dd9a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:23.835375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a059d531-ecda-4b55-941c-040b9b56dd9a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:23.835791 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a059d531-ecda-4b55-941c-040b9b56dd9a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:23.836170 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:23.836556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a059d531-ecda-4b55-941c-040b9b56dd9a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:23.836678 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:23.837085 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:23.837217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a059d531-ecda-4b55-941c-040b9b56dd9a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:23.837575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a059d531-ecda-4b55-941c-040b9b56dd9a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:23.837805 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:23.838262 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:23.838683 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:23.868308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a059d531-ecda-4b55-941c-040b9b56dd9a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Sep 22 22:21:23.868891 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 474/982] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:23 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:23.977430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:23.985300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9bf99478-4de7-4e30-9c46-6dcd93eccc5a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.160976 Sep 22 22:21:23.985864 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 509/983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:23 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:21:24.880501 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-13f1cc42-0bd6-40d6-8666-2bfb06f7b09e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:24.882578 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-13f1cc42-0bd6-40d6-8666-2bfb06f7b09e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:24.884498 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:24.890103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-13f1cc42-0bd6-40d6-8666-2bfb06f7b09e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:24.890606 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-13f1cc42-0bd6-40d6-8666-2bfb06f7b09e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:24.891046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-13f1cc42-0bd6-40d6-8666-2bfb06f7b09e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:24.891736 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-13f1cc42-0bd6-40d6-8666-2bfb06f7b09e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:24.892186 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-13f1cc42-0bd6-40d6-8666-2bfb06f7b09e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:24.892605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-13f1cc42-0bd6-40d6-8666-2bfb06f7b09e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:24.923107 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-13f1cc42-0bd6-40d6-8666-2bfb06f7b09e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Sep 22 22:21:24.923659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 475/984] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:24 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:25.007737 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:25.008341 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:25.014746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:25.015225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:25.015652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:25.016331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:25.016778 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:25.017222 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:25.150433 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:25.158177 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1f9717df-8e48-46b6-91f1-f7b1955331d3 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.154297 Sep 22 22:21:25.158744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 510/985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:25 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:25.936265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-73cc428c-9f07-49c2-8772-2829fb30d98e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:25.938410 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-73cc428c-9f07-49c2-8772-2829fb30d98e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:25.945344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73cc428c-9f07-49c2-8772-2829fb30d98e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:25.945824 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73cc428c-9f07-49c2-8772-2829fb30d98e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:25.946252 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73cc428c-9f07-49c2-8772-2829fb30d98e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:25.946931 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73cc428c-9f07-49c2-8772-2829fb30d98e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:25.947378 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73cc428c-9f07-49c2-8772-2829fb30d98e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:25.947792 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-73cc428c-9f07-49c2-8772-2829fb30d98e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:25.973650 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:25.978664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-73cc428c-9f07-49c2-8772-2829fb30d98e tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046345 Sep 22 22:21:25.979210 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 476/986] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:25 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:26.181977 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:26.182498 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:26.188812 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:26.189334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:26.189764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:26.191469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:26.191938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:26.192363 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:26.322073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:26.329795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-668845ef-1550-4860-b6ff-a7728c480036 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.151758 Sep 22 22:21:26.330353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 511/987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:26 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:26.991576 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-df03b104-14f1-4585-acc6-2ed4a238b0e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:26.993764 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-df03b104-14f1-4585-acc6-2ed4a238b0e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:27.001157 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df03b104-14f1-4585-acc6-2ed4a238b0e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:27.001635 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df03b104-14f1-4585-acc6-2ed4a238b0e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:27.002065 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df03b104-14f1-4585-acc6-2ed4a238b0e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:27.002747 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df03b104-14f1-4585-acc6-2ed4a238b0e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:27.003831 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df03b104-14f1-4585-acc6-2ed4a238b0e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:27.004350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df03b104-14f1-4585-acc6-2ed4a238b0e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:27.045240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-df03b104-14f1-4585-acc6-2ed4a238b0e5 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057724 Sep 22 22:21:27.045810 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 477/988] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:26 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:27.352379 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:27.352989 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:27.359390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:27.359884 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:27.360323 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:27.361040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:27.361562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:27.361988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:27.494106 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:27.501772 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-25d751e6-2d19-48b6-9ea9-c85abbc7a37a tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.153359 Sep 22 22:21:27.502335 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 512/989] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:27 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:28.058068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-45d63357-5ad1-439b-8d80-4ef95296d870 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:28.059610 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-45d63357-5ad1-439b-8d80-4ef95296d870 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:28.066073 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45d63357-5ad1-439b-8d80-4ef95296d870 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:28.066563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45d63357-5ad1-439b-8d80-4ef95296d870 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:28.066992 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45d63357-5ad1-439b-8d80-4ef95296d870 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:28.067692 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45d63357-5ad1-439b-8d80-4ef95296d870 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:28.068143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45d63357-5ad1-439b-8d80-4ef95296d870 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:28.068565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-45d63357-5ad1-439b-8d80-4ef95296d870 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:28.098897 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-45d63357-5ad1-439b-8d80-4ef95296d870 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Sep 22 22:21:28.099451 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 478/990] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:28 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:28.525158 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:28.525795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:28.532136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:28.532610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:28.533037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:28.533746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:28.534197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:28.534719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:28.668251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:28.676458 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fad78bb8-72c3-43d2-87c1-1b9e1bb002d0 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.155033 Sep 22 22:21:28.677037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 513/991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:28 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:29.111184 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0f7a6fd3-df04-4c4b-b1fd-1a34bbef2b87 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:29.113862 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0f7a6fd3-df04-4c4b-b1fd-1a34bbef2b87 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:29.120204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f7a6fd3-df04-4c4b-b1fd-1a34bbef2b87 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:29.120677 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f7a6fd3-df04-4c4b-b1fd-1a34bbef2b87 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:29.121134 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f7a6fd3-df04-4c4b-b1fd-1a34bbef2b87 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:29.121830 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f7a6fd3-df04-4c4b-b1fd-1a34bbef2b87 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:29.122279 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f7a6fd3-df04-4c4b-b1fd-1a34bbef2b87 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:29.122692 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0f7a6fd3-df04-4c4b-b1fd-1a34bbef2b87 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:29.151733 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0f7a6fd3-df04-4c4b-b1fd-1a34bbef2b87 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Sep 22 22:21:29.152278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 479/992] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:29 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:29.701070 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:29.701701 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:29.708762 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:29.709264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:29.709701 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:29.710381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:29.710830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:29.711251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:29.848156 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:29.856233 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1ad1c216-57a9-4da6-b4a0-7e2ddd9a5e1e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.159045 Sep 22 22:21:29.856810 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 514/993] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:29 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:30.163999 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-23b315d9-b7c9-44ba-9aa6-cd33ca585b79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:30.166182 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-23b315d9-b7c9-44ba-9aa6-cd33ca585b79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:30.172524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23b315d9-b7c9-44ba-9aa6-cd33ca585b79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:30.173006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23b315d9-b7c9-44ba-9aa6-cd33ca585b79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:30.173464 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23b315d9-b7c9-44ba-9aa6-cd33ca585b79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:30.174155 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23b315d9-b7c9-44ba-9aa6-cd33ca585b79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:30.174603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23b315d9-b7c9-44ba-9aa6-cd33ca585b79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:30.175022 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-23b315d9-b7c9-44ba-9aa6-cd33ca585b79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:30.204377 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-23b315d9-b7c9-44ba-9aa6-cd33ca585b79 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Sep 22 22:21:30.204932 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 480/994] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:30 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:30.878508 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:30.879161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:30.886115 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:30.886606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:30.887057 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:30.887742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:30.888200 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:30.888634 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:31.020633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:31.028438 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7ef67b26-8087-48d8-9fc2-a520c9359a3b tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.153815 Sep 22 22:21:31.029005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 515/995] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:30 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:31.217486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-17d17223-e9af-408b-aee6-5fd20d1fbdcd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:31.219550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-17d17223-e9af-408b-aee6-5fd20d1fbdcd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:31.226502 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17d17223-e9af-408b-aee6-5fd20d1fbdcd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:31.226978 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17d17223-e9af-408b-aee6-5fd20d1fbdcd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:31.227407 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17d17223-e9af-408b-aee6-5fd20d1fbdcd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:31.228100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17d17223-e9af-408b-aee6-5fd20d1fbdcd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:31.228529 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17d17223-e9af-408b-aee6-5fd20d1fbdcd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:31.228942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-17d17223-e9af-408b-aee6-5fd20d1fbdcd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:31.257435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-17d17223-e9af-408b-aee6-5fd20d1fbdcd tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Sep 22 22:21:31.257975 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 481/996] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:31 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:32.051769 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:32.052491 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:32.059060 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:32.059544 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:32.059977 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:32.060673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:32.061154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:32.061588 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:32.200404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:32.208400 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-36f4451d-a55b-47c5-ad22-43b527bfa3b1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.161368 Sep 22 22:21:32.209248 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 516/997] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:32 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:32.269916 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-658fa8b2-5119-44d1-ba54-b6ec130e2b5f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:32.272124 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-658fa8b2-5119-44d1-ba54-b6ec130e2b5f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:32.278436 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-658fa8b2-5119-44d1-ba54-b6ec130e2b5f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:32.278915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-658fa8b2-5119-44d1-ba54-b6ec130e2b5f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:32.279345 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-658fa8b2-5119-44d1-ba54-b6ec130e2b5f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:32.280024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-658fa8b2-5119-44d1-ba54-b6ec130e2b5f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:32.280470 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-658fa8b2-5119-44d1-ba54-b6ec130e2b5f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:32.280886 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-658fa8b2-5119-44d1-ba54-b6ec130e2b5f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:32.310739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-658fa8b2-5119-44d1-ba54-b6ec130e2b5f tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Sep 22 22:21:32.311287 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 482/998] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:32 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:33.094898 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ef85d413-1882-4fb1-ad70-ed57dde5b616 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:33.097241 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ef85d413-1882-4fb1-ad70-ed57dde5b616 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:33.104000 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef85d413-1882-4fb1-ad70-ed57dde5b616 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.104484 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef85d413-1882-4fb1-ad70-ed57dde5b616 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.104924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef85d413-1882-4fb1-ad70-ed57dde5b616 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.105639 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef85d413-1882-4fb1-ad70-ed57dde5b616 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.106091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef85d413-1882-4fb1-ad70-ed57dde5b616 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.106508 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ef85d413-1882-4fb1-ad70-ed57dde5b616 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.137903 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ef85d413-1882-4fb1-ad70-ed57dde5b616 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046813 Sep 22 22:21:33.138462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 517/999] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:33 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:33.230931 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:33.231834 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:33.238068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.239746 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.240936 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.241678 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.242135 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.242553 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.279821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3fc774e-03b5-4dc9-bdd3-993275e87824 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:33.280333 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d3fc774e-03b5-4dc9-bdd3-993275e87824 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:33.286859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc774e-03b5-4dc9-bdd3-993275e87824 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.287354 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc774e-03b5-4dc9-bdd3-993275e87824 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.287802 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc774e-03b5-4dc9-bdd3-993275e87824 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.288504 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc774e-03b5-4dc9-bdd3-993275e87824 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.288962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc774e-03b5-4dc9-bdd3-993275e87824 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.289415 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3fc774e-03b5-4dc9-bdd3-993275e87824 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.320990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d3fc774e-03b5-4dc9-bdd3-993275e87824 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/13888e08-6721-4a3f-a26b-7747be0e8dfa" status: 200 len: 194 microversion: 2.1 time: 0.044992 Sep 22 22:21:33.321610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 518/1000] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Sep 22 22:21:33 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/13888e08-6721-4a3f-a26b-7747be0e8dfa => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:21:33.326268 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0c1055f1-85c9-4cd2-b618-99991e40bd41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:33.328443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0c1055f1-85c9-4cd2-b618-99991e40bd41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:33.334699 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c1055f1-85c9-4cd2-b618-99991e40bd41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.335227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c1055f1-85c9-4cd2-b618-99991e40bd41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.335668 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c1055f1-85c9-4cd2-b618-99991e40bd41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.336370 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c1055f1-85c9-4cd2-b618-99991e40bd41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.336828 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c1055f1-85c9-4cd2-b618-99991e40bd41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.337343 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0c1055f1-85c9-4cd2-b618-99991e40bd41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.367127 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0c1055f1-85c9-4cd2-b618-99991e40bd41 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044371 Sep 22 22:21:33.367702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 519/1001] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:33 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 22:21:33.372207 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:33.372932 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:33.379747 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.380808 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.381334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.382114 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.382653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.383215 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.385401 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:33.395234 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-900931eb-1933-41ae-9c02-ae9df9e97efd tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.167897 Sep 22 22:21:33.405311 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 483/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:33 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:33.437943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:33.438574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:33.444756 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.445310 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.445748 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.446435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.446889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.447310 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.464680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lazy-loading 'services' on Instance uuid 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:21:33.472789 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:21:33.540095 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dc5a779a-8272-46aa-ad22-d08b5c1ee09d tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/13888e08-6721-4a3f-a26b-7747be0e8dfa" status: 202 len: 0 microversion: 2.1 time: 0.171158 Sep 22 22:21:33.540896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 520/1003] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:21:33 2022] DELETE /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/13888e08-6721-4a3f-a26b-7747be0e8dfa => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:21:33.564878 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-31353d55-29ac-4cef-a7d9-12b5c0a79672 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 204 len: 0 microversion: 2.1 time: 0.127996 Sep 22 22:21:33.565576 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 484/1004] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:21:33 2022] DELETE /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 22:21:33.577923 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:33.578762 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:33.586010 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.586501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.586938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.587633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.588091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.588514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.721256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:33.723728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:33.731249 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-061583bc-39a7-45a6-b424-ec9bd0ef3210 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1681 microversion: 2.1 time: 0.160775 Sep 22 22:21:33.731865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 521/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:33 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:21:33.848542 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-52f4e8b0-6e6f-4ab9-88ea-a1f049d5a8af req-8fff2104-edff-4a3c-ba43-320668e4cd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2feb92db-975d-4abf-8814-603da11f8603", "name": "network-vif-plugged", "status": "completed", "tag": "2f531c40-7605-4ab0-bed8-8a0000e6cd28"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:21:33.858305 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-52f4e8b0-6e6f-4ab9-88ea-a1f049d5a8af req-8fff2104-edff-4a3c-ba43-320668e4cd0f service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:33.858858 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-52f4e8b0-6e6f-4ab9-88ea-a1f049d5a8af req-8fff2104-edff-4a3c-ba43-320668e4cd0f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:33.859300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-52f4e8b0-6e6f-4ab9-88ea-a1f049d5a8af req-8fff2104-edff-4a3c-ba43-320668e4cd0f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:33.870293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-52f4e8b0-6e6f-4ab9-88ea-a1f049d5a8af req-8fff2104-edff-4a3c-ba43-320668e4cd0f service nova] Creating event network-vif-plugged:2f531c40-7605-4ab0-bed8-8a0000e6cd28 for instance 2feb92db-975d-4abf-8814-603da11f8603 on hv-cinder-84914 Sep 22 22:21:33.874971 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-52f4e8b0-6e6f-4ab9-88ea-a1f049d5a8af req-8fff2104-edff-4a3c-ba43-320668e4cd0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088006 Sep 22 22:21:33.875552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 485/1006] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:21:34.419740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:34.420353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:34.428021 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:34.428502 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:34.428938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:34.429661 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:34.430119 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:34.430547 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:34.562270 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:34.569857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-eeef9c50-f5df-4a98-8187-9a66f4463e6d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.154372 Sep 22 22:21:34.570426 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 522/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:34 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:34.755649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:34.756345 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:34.758272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:34.763527 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:34.764008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:34.764444 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:34.765152 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:34.765605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:34.766025 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:34.896485 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:34.904115 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-731ef92c-ae90-43d1-b913-7e1eac022f1c tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1681 microversion: 2.1 time: 0.153210 Sep 22 22:21:34.904688 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 486/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:34 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:35.592768 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:35.593606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:35.600804 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:35.601337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:35.601775 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:35.602482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:35.602938 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:35.603366 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:35.739978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:35.747558 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-90b8db68-8e04-4eaa-a2c6-699271479e47 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.158801 Sep 22 22:21:35.748130 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 523/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:35 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:35.928089 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:35.928708 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:35.935519 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:35.936010 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:35.936447 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:35.937184 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:35.937646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:35.938075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:36.068800 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:36.076556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-98065758-a5ef-4aa5-b74a-0b31121d8878 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1681 microversion: 2.1 time: 0.153231 Sep 22 22:21:36.077148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 487/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:35 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:36.770622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:36.771312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:36.778752 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:36.779241 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:36.779671 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:36.780364 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:36.780815 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:36.781258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:36.924004 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:36.934329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1c4b8795-175f-47e2-9100-cb719c859b39 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1265 microversion: 2.1 time: 0.167180 Sep 22 22:21:36.935164 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 524/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:36 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:37.101035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:37.101682 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:37.108561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:37.109338 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:37.109785 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:37.110493 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:37.110949 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:37.111375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:37.249882 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:37.258683 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cb43bcca-4a97-4599-9ac6-0931ec270435 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1681 microversion: 2.1 time: 0.162469 Sep 22 22:21:37.259689 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 488/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:37 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:37.607564 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-0d360a70-6529-4eb0-b40d-07b639ea60c3 req-bdda2d68-13e0-476e-b066-1ef7c54066e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fabbba-5575-4388-a3e4-2927edcb7026", "name": "network-vif-deleted", "tag": "14a75f4e-b63a-4d20-adaa-5a0575ec7510"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:21:37.617784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0d360a70-6529-4eb0-b40d-07b639ea60c3 req-bdda2d68-13e0-476e-b066-1ef7c54066e0 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:37.618517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0d360a70-6529-4eb0-b40d-07b639ea60c3 req-bdda2d68-13e0-476e-b066-1ef7c54066e0 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:37.618950 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-0d360a70-6529-4eb0-b40d-07b639ea60c3 req-bdda2d68-13e0-476e-b066-1ef7c54066e0 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:37.631929 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-0d360a70-6529-4eb0-b40d-07b639ea60c3 req-bdda2d68-13e0-476e-b066-1ef7c54066e0 service nova] Creating event network-vif-deleted:14a75f4e-b63a-4d20-adaa-5a0575ec7510 for instance d1fabbba-5575-4388-a3e4-2927edcb7026 on hv-cinder-84914 Sep 22 22:21:37.636994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-0d360a70-6529-4eb0-b40d-07b639ea60c3 req-bdda2d68-13e0-476e-b066-1ef7c54066e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093263 Sep 22 22:21:37.637644 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 525/1013] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:37.857953 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-137b9ef9-42e0-49ab-9d7a-9768865843f3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:37.858522 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-137b9ef9-42e0-49ab-9d7a-9768865843f3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:37.866325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-137b9ef9-42e0-49ab-9d7a-9768865843f3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:37.866755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-137b9ef9-42e0-49ab-9d7a-9768865843f3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:37.867272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-137b9ef9-42e0-49ab-9d7a-9768865843f3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:37.868059 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-137b9ef9-42e0-49ab-9d7a-9768865843f3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:37.868734 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-137b9ef9-42e0-49ab-9d7a-9768865843f3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:37.869375 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-137b9ef9-42e0-49ab-9d7a-9768865843f3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:37.899106 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-137b9ef9-42e0-49ab-9d7a-9768865843f3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/e1aa933e-63c1-4af8-8c42-ed7644c67d0d" status: 200 len: 194 microversion: 2.1 time: 0.045099 Sep 22 22:21:37.899687 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 489/1014] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Sep 22 22:21:37 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/e1aa933e-63c1-4af8-8c42-ed7644c67d0d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:37.911354 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:37.912008 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:37.918110 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:37.918664 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:37.919164 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:37.919937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:37.920457 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:37.920944 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:37.957707 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:37.958396 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:37.964564 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:37.965054 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:37.965591 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:37.966293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:37.966746 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:37.967177 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:38.008326 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lazy-loading 'services' on Instance uuid 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:21:38.106186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7b85ea28-9bc5-488b-a7a7-3b565bc7b0b3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/e1aa933e-63c1-4af8-8c42-ed7644c67d0d" status: 202 len: 0 microversion: 2.1 time: 0.199590 Sep 22 22:21:38.106820 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 526/1015] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 22 22:21:37 2022] DELETE /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments/e1aa933e-63c1-4af8-8c42-ed7644c67d0d => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:21:38.115112 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:38.123033 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-359547ec-1434-49ba-955f-e5112158cd0e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1452 microversion: 2.1 time: 0.169080 Sep 22 22:21:38.123611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 490/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:37 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:21:38.146545 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:38.147562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:38.154292 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:38.155225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:38.155843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:38.156839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:38.157595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:38.158247 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:38.283279 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:38.284230 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:38.292276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:38.292788 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:38.293239 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:38.299552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:38.300184 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:38.300651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:38.320014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:38.328235 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a540a330-4177-430b-bec0-d0cd4d74225f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1452 microversion: 2.1 time: 0.186110 Sep 22 22:21:38.329150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 527/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:38 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:38.341222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:38.341702 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:38.342130 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:38.342569 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lazy-loading 'fault' on Instance uuid d1fabbba-5575-4388-a3e4-2927edcb7026 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:21:38.396684 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb617f1f41c467fba9717f7f825ac80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '226257b343d24054bc2178b47a9a5a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:38.417765 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-911587b1-6048-4818-bd50-5506d3805a0a tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 200 len: 1330 microversion: 2.1 time: 0.137023 Sep 22 22:21:38.433088 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 491/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:38 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 1330 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:21:39.443507 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:39.444109 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:39.451579 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:39.452123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:39.452563 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:39.453294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:39.453935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:39.454529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:39.468389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 HTTP/1.1 Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:21:39.470201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:39.472688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'd1fabbba-5575-4388-a3e4-2927edcb7026'} Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:39.473821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:39.475210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:39.477982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:39.477982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a1152ce0-a1cc-49b6-850c-d82297ccdaf8 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 404 len: 111 microversion: 2.1 time: 0.032921 Sep 22 22:21:39.477982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 528/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:39 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:39.480614 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9b328422-4d56-42e8-8852-158c42a4bf34 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '.version_select at 0x7f405ca54160>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:39.485444 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9b328422-4d56-42e8-8852-158c42a4bf34 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [a78b66a7-7339-491a-98b2-d9ed568e839c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 22:21:40.085440 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-db6de63a-8702-4aa2-be27-1a8ad763c54a req-0749e408-2ce5-4556-8b51-2964e633fe96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2feb92db-975d-4abf-8814-603da11f8603", "tag": "2f531c40-7605-4ab0-bed8-8a0000e6cd28"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:21:40.094576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-db6de63a-8702-4aa2-be27-1a8ad763c54a req-0749e408-2ce5-4556-8b51-2964e633fe96 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:40.095048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-db6de63a-8702-4aa2-be27-1a8ad763c54a req-0749e408-2ce5-4556-8b51-2964e633fe96 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:40.095475 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-db6de63a-8702-4aa2-be27-1a8ad763c54a req-0749e408-2ce5-4556-8b51-2964e633fe96 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:40.107415 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-db6de63a-8702-4aa2-be27-1a8ad763c54a req-0749e408-2ce5-4556-8b51-2964e633fe96 service nova] Creating event network-changed:2f531c40-7605-4ab0-bed8-8a0000e6cd28 for instance 2feb92db-975d-4abf-8814-603da11f8603 on hv-cinder-84914 Sep 22 22:21:40.112584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-db6de63a-8702-4aa2-be27-1a8ad763c54a req-0749e408-2ce5-4556-8b51-2964e633fe96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031306 Sep 22 22:21:40.113212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 529/1020] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:21:40.359630 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3a4af451-9437-4e76-a81f-44afe53efe5a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:40.362274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3a4af451-9437-4e76-a81f-44afe53efe5a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:40.368894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a4af451-9437-4e76-a81f-44afe53efe5a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:40.369549 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a4af451-9437-4e76-a81f-44afe53efe5a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:40.370059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a4af451-9437-4e76-a81f-44afe53efe5a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:40.370969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a4af451-9437-4e76-a81f-44afe53efe5a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:40.371424 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a4af451-9437-4e76-a81f-44afe53efe5a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:40.371859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3a4af451-9437-4e76-a81f-44afe53efe5a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:40.402734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3a4af451-9437-4e76-a81f-44afe53efe5a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047362 Sep 22 22:21:40.403297 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 530/1021] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:40 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 22:21:40.492526 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [None req-9b328422-4d56-42e8-8852-158c42a4bf34 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [a78b66a7-7339-491a-98b2-d9ed568e839c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 60604. Sep 22 22:21:40.527506 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9b328422-4d56-42e8-8852-158c42a4bf34 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-942195074" status: 202 len: 0 microversion: 2.1 time: 1.050553 Sep 22 22:21:40.529366 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 492/1022] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Sep 22 22:21:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-942195074 => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 22:21:40.533738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-963a41ee-5f22-4012-8927-6efe44d7c8f0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:40.536714 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-963a41ee-5f22-4012-8927-6efe44d7c8f0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:40.543931 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963a41ee-5f22-4012-8927-6efe44d7c8f0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:40.544794 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963a41ee-5f22-4012-8927-6efe44d7c8f0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:40.545558 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963a41ee-5f22-4012-8927-6efe44d7c8f0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:40.546343 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963a41ee-5f22-4012-8927-6efe44d7c8f0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:40.547027 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963a41ee-5f22-4012-8927-6efe44d7c8f0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:40.547685 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-963a41ee-5f22-4012-8927-6efe44d7c8f0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:40.580743 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-963a41ee-5f22-4012-8927-6efe44d7c8f0 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051124 Sep 22 22:21:40.581875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 531/1023] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 22 22:21:40 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 22:21:40.652528 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:40.653134 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:40.661805 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:40.662567 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:40.663265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:40.664541 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:40.665030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:40.665536 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:40.676606 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:40.701967 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:21:40.800721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3a2ece94-8b44-403f-985d-bd03b67ccd6a tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 204 len: 0 microversion: 2.1 time: 0.151791 Sep 22 22:21:40.803585 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 493/1024] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:21:40 2022] DELETE /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:21:40.812649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:40.813302 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:40.820491 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:40.820981 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:40.821451 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:40.822266 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:40.822719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:40.823337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:40.975708 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:40.985600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4ae9c3f6-ba18-49b4-b035-83034bc881e7 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1675 microversion: 2.1 time: 0.178011 Sep 22 22:21:40.997330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 532/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:40 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:42.011303 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:42.012021 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:42.018336 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:42.018814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:42.019238 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:42.019920 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:42.020372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:42.020875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:42.153313 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:42.161042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a68f41f4-68bf-49fa-aa31-2c4fbffa4d3c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1675 microversion: 2.1 time: 0.154056 Sep 22 22:21:42.161636 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 494/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:42 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:21:42.365480 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:42.366166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:42.368586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:21:42.373902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:42.374384 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:42.374821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:42.375513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:42.375966 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:42.376389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:42.391377 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 HTTP/1.1 Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:21:42.393071 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.394721 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'd1fabbba-5575-4388-a3e4-2927edcb7026'} Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:42.395623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.397202 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.398980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:42.398980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e2e8acaf-4ea2-4a6b-959c-cc905fe19f73 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 404 len: 111 microversion: 2.1 time: 0.033358 Sep 22 22:21:42.398980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 533/1027] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:21:42 2022] DELETE /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:42.403084 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:42.403685 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: d1fabbba-5575-4388-a3e4-2927edcb7026] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:42.409846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:42.410336 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:42.410772 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:42.411462 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:42.412043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:42.412486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:42.425471 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 HTTP/1.1 Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:21:42.427121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.429594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': 'd1fabbba-5575-4388-a3e4-2927edcb7026'} Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:42.430556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. Sep 22 22:21:42.432051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:42.433350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance d1fabbba-5575-4388-a3e4-2927edcb7026 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:42.433350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fb71d925-eb49-4bff-a779-3fa566694220 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026" status: 404 len: 111 microversion: 2.1 time: 0.029994 Sep 22 22:21:42.433350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 495/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:42 2022] GET /compute/v2.1/servers/d1fabbba-5575-4388-a3e4-2927edcb7026 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:43.184918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:43.185559 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:43.191916 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.192698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.193197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.194238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.194700 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.195122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.337042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:43.347266 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-573ce7d5-47af-4942-8439-7a68c6b99e05 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1675 microversion: 2.1 time: 0.166361 Sep 22 22:21:43.347853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 534/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:43 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:43.569335 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:43.569873 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:43.576255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.576743 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.577207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.577912 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.578444 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.578869 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.592877 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 HTTP/1.1 Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:21:43.594454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.596100 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': 'c0d604e6-1975-480b-ac89-1fa7caf675f4'} Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:43.597035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.598563 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.600570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:43.600570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5115f5ec-e245-47b5-95c9-5ccc3336754d tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 404 len: 111 microversion: 2.1 time: 0.030573 Sep 22 22:21:43.600570 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 496/1030] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:21:43 2022] DELETE /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:43.604922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:43.605570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: c0d604e6-1975-480b-ac89-1fa7caf675f4] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:43.611429 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.611910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.612345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.613042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.613527 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.613952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.627717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 HTTP/1.1 Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:21:43.629304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.631046 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'c0d604e6-1975-480b-ac89-1fa7caf675f4'} Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:43.632001 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. Sep 22 22:21:43.633584 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.634910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance c0d604e6-1975-480b-ac89-1fa7caf675f4 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:43.634910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dfeb7bbb-f3af-4a9b-a041-944450daa1fc tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4" status: 404 len: 111 microversion: 2.1 time: 0.029602 Sep 22 22:21:43.634910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 535/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:43 2022] GET /compute/v2.1/servers/c0d604e6-1975-480b-ac89-1fa7caf675f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:43.640452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:43.640957 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:43.647187 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.647678 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.648118 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.648819 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.649393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.649826 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.663757 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c HTTP/1.1 Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:21:43.665356 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '60e7432c-e9dc-49c3-a476-991a48adde7c'} Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:43.667811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.669258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.670708 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:43.670708 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2c8a7f8f-3527-4677-b658-c0c65e43b886 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 404 len: 111 microversion: 2.1 time: 0.030236 Sep 22 22:21:43.670708 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 497/1032] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:21:43 2022] DELETE /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:43.675226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:43.675844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 60e7432c-e9dc-49c3-a476-991a48adde7c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:43.683196 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.683684 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.684122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.684819 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:43.685324 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:43.685760 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:43.699883 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c HTTP/1.1 Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:21:43.701473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.703116 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '60e7432c-e9dc-49c3-a476-991a48adde7c'} Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:43.704072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. Sep 22 22:21:43.705666 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:43.707289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance 60e7432c-e9dc-49c3-a476-991a48adde7c could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:43.707289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6d7bedce-6607-4604-ae00-3264e2b27ac2 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c" status: 404 len: 111 microversion: 2.1 time: 0.031576 Sep 22 22:21:43.709054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 536/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:43 2022] GET /compute/v2.1/servers/60e7432c-e9dc-49c3-a476-991a48adde7c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:44.203943 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-8a004097-6b5c-427c-8488-970247a25fb8 req-8153e7fc-c116-452b-b11c-9f87482aa9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03", "name": "network-vif-deleted", "tag": "0442a6b6-83cd-4999-8bc7-27ce501c9b84"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:21:44.217305 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8a004097-6b5c-427c-8488-970247a25fb8 req-8153e7fc-c116-452b-b11c-9f87482aa9ff service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:44.217305 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8a004097-6b5c-427c-8488-970247a25fb8 req-8153e7fc-c116-452b-b11c-9f87482aa9ff service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:44.217700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8a004097-6b5c-427c-8488-970247a25fb8 req-8153e7fc-c116-452b-b11c-9f87482aa9ff service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:44.232597 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-8a004097-6b5c-427c-8488-970247a25fb8 req-8153e7fc-c116-452b-b11c-9f87482aa9ff service nova] Creating event network-vif-deleted:0442a6b6-83cd-4999-8bc7-27ce501c9b84 for instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 on hv-cinder-84914 Sep 22 22:21:44.239248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-8a004097-6b5c-427c-8488-970247a25fb8 req-8153e7fc-c116-452b-b11c-9f87482aa9ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039324 Sep 22 22:21:44.240598 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 498/1034] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:21:44.371426 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:44.372286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:44.379509 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:44.380255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:44.381655 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:44.382762 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:44.383536 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:44.384134 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:44.429147 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:44.430494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:44.430956 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:44.431634 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lazy-loading 'fault' on Instance uuid 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:21:44.475112 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e294148e14459a96190fab931d4898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650863eae15e4733b50e22c7595d7742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:21:44.483322 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6192567c-f61c-4400-8a73-f59891828f6c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 200 len: 1328 microversion: 2.1 time: 0.115845 Sep 22 22:21:44.497775 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 537/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:44 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 1328 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:21:44.853494 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:44.855152 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:44.862273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:44.864178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:44.865040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:44.867215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:44.867498 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:44.867928 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:44.894107 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 HTTP/1.1 Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:21:44.896093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.897885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '765e0b40-b687-4b25-b264-0b84e9d0a8a3'} Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:44.898851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.903496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.905091 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:44.905091 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1b861608-9a85-4739-a29f-c336de0c21d4 tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "DELETE /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 404 len: 111 microversion: 2.1 time: 0.051272 Sep 22 22:21:44.905091 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 499/1036] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:21:44 2022] DELETE /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:44.913098 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:44.913760 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] [instance: 765e0b40-b687-4b25-b264-0b84e9d0a8a3] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:44.931161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:44.931659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:44.932093 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:44.933647 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:44.934119 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:44.934577 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:44.949676 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] HTTP exception thrown: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Request method failure captured: Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 HTTP/1.1 Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN1McWLUUCsO9POYkp-w8X4nJDhHK2cnuESUf7r3FSnwCGiVY2SfZMoPbErdEEL830t5SCuUtywYYtrLVKkqo6Tqf3M_zopqMR58rRz_0IoDMVIykQRn-eOGO53qRk3Ku27jtfQVbWqf060t6qMNcp00-yE5tgajilaC82_ZT3AzUZ0 Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:21:44.951236 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/226257b343d24054bc2178b47a9a5a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_226257b343d24054bc2178b47a9a5a4f", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 226257b343d24054bc2178b47a9a5a4f Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-861873472 Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: bcb617f1f41c467fba9717f7f825ac80 Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeNegativeTest-861873472-project Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.952784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '765e0b40-b687-4b25-b264-0b84e9d0a8a3'} Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:44.953709 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. Sep 22 22:21:44.954940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:44.956038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] Returning 404 to user: Instance 765e0b40-b687-4b25-b264-0b84e9d0a8a3 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:44.956038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-91732312-c5c6-442a-890b-eafd7223dd4b tempest-AttachVolumeNegativeTest-861873472 tempest-AttachVolumeNegativeTest-861873472-project] 10.222.0.25 "GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3" status: 404 len: 111 microversion: 2.1 time: 0.049669 Sep 22 22:21:44.956038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 538/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:44 2022] GET /compute/v2.1/servers/765e0b40-b687-4b25-b264-0b84e9d0a8a3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:45.507292 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:45.507915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:45.513832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:45.514322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:45.514761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:45.515463 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:45.515920 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:45.516348 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:45.530646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] HTTP exception thrown: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Request method failure captured: Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 HTTP/1.1 Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN3N0Kbkdxavu16xjx6CjZQIsWrRa9uuMMpdKqZo6po00pKu5iCwKq8Y4SdlXOTtK3R467UMp6JFNUizfVhqsWMD3JjwGoQEpm63AaxxAePB0cnZABdApjgYymtkObf2_ajlagaDmXXKvPMLbvCP7uTQVDMa2oV4A2u4EAOHREBu44g Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:21:45.532208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/650863eae15e4733b50e22c7595d7742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_650863eae15e4733b50e22c7595d7742", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 62e294148e14459a96190fab931d4898 Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:45.533896 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03'} Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:45.535496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:45.537069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:45.539970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Returning 404 to user: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:45.539970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2a6d9084-9d4c-429e-a2fd-4c82075c64c8 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 404 len: 111 microversion: 2.1 time: 0.030704 Sep 22 22:21:45.539970 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 500/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:45 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:45.543064 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-04907b27-ccc6-4d6f-9b5a-1a2c45e3ebc3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '.version_select at 0x7f405cbf8d30>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:45.547552 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR oslo.messaging._drivers.impl_rabbit [None req-04907b27-ccc6-4d6f-9b5a-1a2c45e3ebc3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [3fe0809d-545a-4f2f-a3b9-d21e8377593c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 22:21:46.555761 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [None req-04907b27-ccc6-4d6f-9b5a-1a2c45e3ebc3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [3fe0809d-545a-4f2f-a3b9-d21e8377593c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 60674. Sep 22 22:21:46.579232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-04907b27-ccc6-4d6f-9b5a-1a2c45e3ebc3 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831919075" status: 202 len: 0 microversion: 2.1 time: 1.039751 Sep 22 22:21:46.580221 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 539/1039] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 22 22:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831919075 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:21:49.626171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:49.626171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:49.632828 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:49.633542 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:49.633973 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:49.634670 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:49.635123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:49.635540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:49.649008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] HTTP exception thrown: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Request method failure captured: Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 HTTP/1.1 Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN3N0Kbkdxavu16xjx6CjZQIsWrRa9uuMMpdKqZo6po00pKu5iCwKq8Y4SdlXOTtK3R467UMp6JFNUizfVhqsWMD3JjwGoQEpm63AaxxAePB0cnZABdApjgYymtkObf2_ajlagaDmXXKvPMLbvCP7uTQVDMa2oV4A2u4EAOHREBu44g Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:21:49.650568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/650863eae15e4733b50e22c7595d7742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_650863eae15e4733b50e22c7595d7742", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 62e294148e14459a96190fab931d4898 Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.652024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03'} Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:49.652814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.654204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.655651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Returning 404 to user: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:49.655651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d8921f03-20e9-4036-a9eb-028293158c33 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 404 len: 111 microversion: 2.1 time: 0.030272 Sep 22 22:21:49.655842 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 501/1040] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:21:49 2022] DELETE /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:49.661708 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:49.662329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:49.669161 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:49.669663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:49.670105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:49.670803 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:49.671261 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:49.671688 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:49.686503 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] HTTP exception thrown: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Request method failure captured: Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 HTTP/1.1 Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN3N0Kbkdxavu16xjx6CjZQIsWrRa9uuMMpdKqZo6po00pKu5iCwKq8Y4SdlXOTtK3R467UMp6JFNUizfVhqsWMD3JjwGoQEpm63AaxxAePB0cnZABdApjgYymtkObf2_ajlagaDmXXKvPMLbvCP7uTQVDMa2oV4A2u4EAOHREBu44g Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:21:49.688036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/650863eae15e4733b50e22c7595d7742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_650863eae15e4733b50e22c7595d7742", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 62e294148e14459a96190fab931d4898 Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.689680 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03'} Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:49.690551 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. Sep 22 22:21:49.692035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:49.693401 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Returning 404 to user: Instance 8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:49.693401 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-72e5e839-494d-42f4-9e6e-730582eafe97 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03" status: 404 len: 111 microversion: 2.1 time: 0.032384 Sep 22 22:21:49.693401 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 540/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:49 2022] GET /compute/v2.1/servers/8f6ee6a4-9c0b-492e-bc4f-01d88f4f2a03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:50.848768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:50.849312 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:50.855873 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:50.856350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:50.856779 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:50.857559 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:50.858013 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:50.858430 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:50.872126 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] HTTP exception thrown: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Request method failure captured: Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 HTTP/1.1 Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN3N0Kbkdxavu16xjx6CjZQIsWrRa9uuMMpdKqZo6po00pKu5iCwKq8Y4SdlXOTtK3R467UMp6JFNUizfVhqsWMD3JjwGoQEpm63AaxxAePB0cnZABdApjgYymtkObf2_ajlagaDmXXKvPMLbvCP7uTQVDMa2oV4A2u4EAOHREBu44g Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:21:50.873717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/650863eae15e4733b50e22c7595d7742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_650863eae15e4733b50e22c7595d7742", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 62e294148e14459a96190fab931d4898 Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.875326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': 'fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8'} Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:50.876260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.877801 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.879332 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Returning 404 to user: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:50.879332 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c1123fd9-72cd-45a1-bbec-19ad92b4c36c tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 404 len: 111 microversion: 2.1 time: 0.030188 Sep 22 22:21:50.879332 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 502/1042] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:21:50 2022] DELETE /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:21:50.884013 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:21:50.884619 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] [instance: fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:21:50.890988 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:50.891466 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:50.891897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:50.892577 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:21:50.893028 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:21:50.893479 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:21:50.906837 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] HTTP exception thrown: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Request method failure captured: Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 HTTP/1.1 Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN3N0Kbkdxavu16xjx6CjZQIsWrRa9uuMMpdKqZo6po00pKu5iCwKq8Y4SdlXOTtK3R467UMp6JFNUizfVhqsWMD3JjwGoQEpm63AaxxAePB0cnZABdApjgYymtkObf2_ajlagaDmXXKvPMLbvCP7uTQVDMa2oV4A2u4EAOHREBu44g Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:21:50.908339 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/650863eae15e4733b50e22c7595d7742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/650863eae15e4733b50e22c7595d7742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_650863eae15e4733b50e22c7595d7742", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: 650863eae15e4733b50e22c7595d7742 Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1521090279 Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 62e294148e14459a96190fab931d4898 Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeTestJSON-1521090279-project Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.909976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8'} Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:21:50.910833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. Sep 22 22:21:50.912074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:21:50.913390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] Returning 404 to user: Instance fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:21:50.913390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ea79a677-48bc-4129-872e-2c3accbc1612 tempest-AttachVolumeTestJSON-1521090279 tempest-AttachVolumeTestJSON-1521090279-project] 10.222.0.25 "GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8" status: 404 len: 111 microversion: 2.1 time: 0.030138 Sep 22 22:21:50.913390 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 541/1043] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:21:50 2022] GET /compute/v2.1/servers/fbfacaf8-a2f6-42fb-9790-eb0ae1acf6b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:22:37.364326 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1077721609", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "networks": [{"uuid": "0988fd66-6f7a-4942-ab4d-2ae3bc59d161"}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:22:37.372990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:37.373658 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:37.422975 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] validate_networks() for [('0988fd66-6f7a-4942-ab4d-2ae3bc59d161', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:22:37.803197 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:22:37.803624 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:22:37.804098 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:22:37.804508 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:22:37.804921 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:22:37.814189 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:37.814674 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:37.815111 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:37.815840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:37.816295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:37.816783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:37.833427 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Getting quotas for project ed0761f1f2a148ce8b55f519a13421c8. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:22:37.837440 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Getting quotas for user 59d6a1d6b9bc4daf8542b58cf62fff1a and project ed0761f1f2a148ce8b55f519a13421c8. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:22:37.849853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:22:37.852225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:22:37.899034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dadbb97d-95c6-408d-9511-385661acbf11 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538557 Sep 22 22:22:37.899725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 503/1044] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:22:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:22:37.911102 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-15145248-38e8-4992-a228-dce7ffc3c6c2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:37.912345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-15145248-38e8-4992-a228-dce7ffc3c6c2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:37.915623 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:37.916297 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:37.972855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-15145248-38e8-4992-a228-dce7ffc3c6c2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:37.980051 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-15145248-38e8-4992-a228-dce7ffc3c6c2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1214 microversion: 2.1 time: 0.072727 Sep 22 22:22:37.980708 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 542/1045] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:37 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:22:38.099808 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e4b415c1-57fd-4378-9f13-1fffe8084135 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:38.100420 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e4b415c1-57fd-4378-9f13-1fffe8084135 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:38.107744 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b415c1-57fd-4378-9f13-1fffe8084135 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:38.108359 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b415c1-57fd-4378-9f13-1fffe8084135 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:38.110072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b415c1-57fd-4378-9f13-1fffe8084135 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:38.110958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b415c1-57fd-4378-9f13-1fffe8084135 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:38.111580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b415c1-57fd-4378-9f13-1fffe8084135 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:38.112003 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e4b415c1-57fd-4378-9f13-1fffe8084135 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:38.151383 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e4b415c1-57fd-4378-9f13-1fffe8084135 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments/5372d210-1843-4f5b-b08a-901bbf8b8a9d" status: 200 len: 194 microversion: 2.20 time: 0.055995 Sep 22 22:22:38.152024 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 504/1046] 10.222.0.25 () {60 vars in 1454 bytes} [Thu Sep 22 22:22:38 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments/5372d210-1843-4f5b-b08a-901bbf8b8a9d => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:22:38.237747 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:38.238203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:38.244183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:38.244683 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:38.245142 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:38.246049 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:38.246516 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:38.246949 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:38.344764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lazy-loading 'services' on Instance uuid 03073c72-a5ba-4bab-90eb-f92f0396c092 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:22:38.424395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fac235d0-41d2-445e-9643-9bf9841c70d2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments/5372d210-1843-4f5b-b08a-901bbf8b8a9d" status: 202 len: 0 microversion: 2.20 time: 0.191047 Sep 22 22:22:38.426083 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 543/1047] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Sep 22 22:22:38 2022] DELETE /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments/5372d210-1843-4f5b-b08a-901bbf8b8a9d => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 22 22:22:38.433720 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-056cb3d8-4adb-4a7f-a296-2db62dca0785 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:38.436076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-056cb3d8-4adb-4a7f-a296-2db62dca0785 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:38.443308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-056cb3d8-4adb-4a7f-a296-2db62dca0785 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:38.444029 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-056cb3d8-4adb-4a7f-a296-2db62dca0785 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:38.444471 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-056cb3d8-4adb-4a7f-a296-2db62dca0785 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:38.445214 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-056cb3d8-4adb-4a7f-a296-2db62dca0785 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:38.445844 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-056cb3d8-4adb-4a7f-a296-2db62dca0785 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:38.447081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-056cb3d8-4adb-4a7f-a296-2db62dca0785 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:38.481743 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-056cb3d8-4adb-4a7f-a296-2db62dca0785 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052301 Sep 22 22:22:38.482311 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 505/1048] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 22 22:22:38 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:22:39.005169 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:39.005858 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:39.012016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:39.012489 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:39.012918 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:39.013629 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:39.014079 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:39.014499 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:39.077806 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:39.085994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c3a96c9e-98a8-40c4-a465-60b09df6c216 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1266 microversion: 2.1 time: 0.086235 Sep 22 22:22:39.087836 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 544/1049] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:38 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:39.494272 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4410596a-df1e-419a-a89f-46bf869c2084 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:39.496388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4410596a-df1e-419a-a89f-46bf869c2084 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:39.503241 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4410596a-df1e-419a-a89f-46bf869c2084 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:39.503721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4410596a-df1e-419a-a89f-46bf869c2084 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:39.504259 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4410596a-df1e-419a-a89f-46bf869c2084 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:39.504826 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4410596a-df1e-419a-a89f-46bf869c2084 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:39.505307 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4410596a-df1e-419a-a89f-46bf869c2084 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:39.505779 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4410596a-df1e-419a-a89f-46bf869c2084 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:39.537781 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4410596a-df1e-419a-a89f-46bf869c2084 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047410 Sep 22 22:22:39.538338 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 506/1050] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 22 22:22:39 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:22:40.111535 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:40.112346 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:40.118778 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:40.119296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:40.119735 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:40.120460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:40.120921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:40.121368 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:40.183858 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:40.192221 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dee31495-704a-4ce6-a387-7723c0bfa89d tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1272 microversion: 2.1 time: 0.085442 Sep 22 22:22:40.192795 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 545/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:40 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:40.552239 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cfa4c413-fc9a-46a3-918f-2671fe105f6b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:40.554744 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cfa4c413-fc9a-46a3-918f-2671fe105f6b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:40.561320 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cfa4c413-fc9a-46a3-918f-2671fe105f6b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:40.561816 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cfa4c413-fc9a-46a3-918f-2671fe105f6b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:40.562738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cfa4c413-fc9a-46a3-918f-2671fe105f6b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:40.563816 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cfa4c413-fc9a-46a3-918f-2671fe105f6b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:40.564275 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cfa4c413-fc9a-46a3-918f-2671fe105f6b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:40.564885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cfa4c413-fc9a-46a3-918f-2671fe105f6b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:40.602401 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cfa4c413-fc9a-46a3-918f-2671fe105f6b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055824 Sep 22 22:22:40.602937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 507/1052] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 22 22:22:40 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:40.673544 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:40.674105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:40.680137 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:40.680700 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:40.681240 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:40.682060 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:40.682595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:40.683084 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:40.710697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:22:40.801208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-00266767-bbdf-4b0e-b458-69f3646468c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 204 len: 0 microversion: 2.20 time: 0.131295 Sep 22 22:22:40.805070 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 546/1053] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 22 22:22:40 2022] DELETE /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 22:22:40.811358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:40.812042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:40.819197 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:40.819761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:40.820271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:40.821166 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:40.821928 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:40.822365 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:40.968153 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:40.977745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:40.979205 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:40.980390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2202d3ff-46d8-459b-953f-475b0e3c2267 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.173612 Sep 22 22:22:40.980954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 508/1054] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:40 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:41.216427 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:41.217477 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:41.224737 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:41.225353 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:41.225854 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:41.226641 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:41.227167 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:41.228005 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:41.267370 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-0872d36c-2d9d-4dc2-8231-d4038ce13984 req-b62f9c31-b3b7-45a4-b1ab-16fddb15381f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b", "tag": "6a2dc51e-104b-4cdd-a84e-a105cd734a77"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:22:41.282406 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0872d36c-2d9d-4dc2-8231-d4038ce13984 req-b62f9c31-b3b7-45a4-b1ab-16fddb15381f service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:41.282976 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0872d36c-2d9d-4dc2-8231-d4038ce13984 req-b62f9c31-b3b7-45a4-b1ab-16fddb15381f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:41.283423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0872d36c-2d9d-4dc2-8231-d4038ce13984 req-b62f9c31-b3b7-45a4-b1ab-16fddb15381f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:41.301598 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-0872d36c-2d9d-4dc2-8231-d4038ce13984 req-b62f9c31-b3b7-45a4-b1ab-16fddb15381f service nova] Creating event network-changed:6a2dc51e-104b-4cdd-a84e-a105cd734a77 for instance f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b on hv-cinder-84914 Sep 22 22:22:41.307449 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-0872d36c-2d9d-4dc2-8231-d4038ce13984 req-b62f9c31-b3b7-45a4-b1ab-16fddb15381f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046611 Sep 22 22:22:41.309315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 509/1055] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:22:41.383673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:41.392216 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c18e787e-0979-4fca-972d-eb5c85a2474c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1314 microversion: 2.1 time: 0.180075 Sep 22 22:22:41.392785 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 547/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:41 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:42.008659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:42.009491 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:42.015771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:42.016214 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:42.016754 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:42.017358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:42.017818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:42.018238 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:42.169818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:42.179361 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:42.180795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:42.181980 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-62e7c614-69a7-4af7-9616-e284e74ff8f6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.178044 Sep 22 22:22:42.182699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 510/1057] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:42 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:42.416037 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:42.416982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:42.425012 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:42.425537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:42.425978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:42.426684 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:42.427145 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:42.427573 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:42.605648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:42.613447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c0205af5-aeef-48ef-bcc4-118d434b0e09 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1314 microversion: 2.1 time: 0.201713 Sep 22 22:22:42.614031 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 548/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:42 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:43.210724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:43.210724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:43.216396 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:43.217121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:43.217795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:43.221070 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:43.221786 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:43.222867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:43.476291 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:43.487274 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:43.489068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:43.490741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-252119b1-a24d-4f08-8c6b-aeca3f8d9d64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1725 microversion: 2.20 time: 0.286496 Sep 22 22:22:43.492028 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 511/1059] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:43 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1725 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:43.635873 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:43.636483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:43.655875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:43.657421 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:43.658048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:43.659043 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:43.660156 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:43.660783 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:43.896990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:43.904640 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9ba6a53b-ca5b-45e6-94dd-9e3cd330640b tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1314 microversion: 2.1 time: 0.272612 Sep 22 22:22:43.917428 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 549/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:43 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:44.018649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-50b9f2fd-2ddd-4dd1-9e9a-850fee9ce089 req-0dfd27d5-cee1-4317-a1b5-5a5eab90cf70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03073c72-a5ba-4bab-90eb-f92f0396c092", "name": "network-vif-deleted", "tag": "c8ece83a-0238-40e0-9d0d-3d28f90f9abf"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:22:44.028305 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-50b9f2fd-2ddd-4dd1-9e9a-850fee9ce089 req-0dfd27d5-cee1-4317-a1b5-5a5eab90cf70 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:44.029040 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-50b9f2fd-2ddd-4dd1-9e9a-850fee9ce089 req-0dfd27d5-cee1-4317-a1b5-5a5eab90cf70 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:44.029661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-50b9f2fd-2ddd-4dd1-9e9a-850fee9ce089 req-0dfd27d5-cee1-4317-a1b5-5a5eab90cf70 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:44.041621 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-50b9f2fd-2ddd-4dd1-9e9a-850fee9ce089 req-0dfd27d5-cee1-4317-a1b5-5a5eab90cf70 service nova] Creating event network-vif-deleted:c8ece83a-0238-40e0-9d0d-3d28f90f9abf for instance 03073c72-a5ba-4bab-90eb-f92f0396c092 on hv-cinder-84914 Sep 22 22:22:44.046853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-50b9f2fd-2ddd-4dd1-9e9a-850fee9ce089 req-0dfd27d5-cee1-4317-a1b5-5a5eab90cf70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031750 Sep 22 22:22:44.051169 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 512/1061] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:22:44.518715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:44.519572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:44.525633 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:44.526125 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:44.526583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:44.527266 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:44.527725 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:44.528149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:44.598420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:44.607451 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:44.609097 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:44.610194 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-8b1e8d48-efe1-4313-becd-6b8313b66990 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1658 microversion: 2.20 time: 0.096785 Sep 22 22:22:44.611009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 550/1062] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:44 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1658 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:44.930998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:44.930998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:44.937203 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:44.938324 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:44.939191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:44.939989 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:44.940454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:44.940886 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:45.089862 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:45.098043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cc8e732c-96f5-475f-850e-b36968388913 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1314 microversion: 2.1 time: 0.174132 Sep 22 22:22:45.098604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 513/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:44 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:45.635994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:45.636687 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:45.643788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:45.644281 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:45.644722 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:45.645465 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:45.645919 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:45.646352 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:45.713420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:45.722453 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:45.723900 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:45.725047 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-4633ed9f-15dc-4cd6-946d-4e4103cd93c9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 200 len: 1367 microversion: 2.20 time: 0.093062 Sep 22 22:22:45.725653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 551/1064] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:45 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:46.120144 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:46.120768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:46.134347 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:46.134927 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:46.136029 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:46.138325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:46.139628 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:46.140362 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:46.316758 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:46.324513 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-35a815eb-42ae-4a5d-9807-47a0fc96bd5c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1314 microversion: 2.1 time: 0.208156 Sep 22 22:22:46.325080 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 514/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:46 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:46.752264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:46.753381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:46.759833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:46.760496 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:46.761133 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:46.762098 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:46.762714 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:46.763293 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:46.779557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] HTTP exception thrown: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Request method failure captured: Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 HTTP/1.1 Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN82Dm2ADzy-cpy5J4LucY5HqiMRTmO5Mjx9490AF22Z00EXarB6KsLsFR8igt8tCpA_KeyfTAufqFWGqDtaFEWoRsQQU_UFModfxeHO4oDv8iHmoyhVGOJwJGmTg3RHyHUqqdpIHYM4oYCINoer2tAYefkVHJVk8NKRxH5bLSrylxE Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:22:46.781677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaff29c3c9b84929b0451e8e82caf4f2", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 1b01f21ffa814a5da3873e5387938b2a Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:22:46.783984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '03073c72-a5ba-4bab-90eb-f92f0396c092'} Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:22:46.784902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:22:46.786448 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:22:46.789522 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Returning 404 to user: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:22:46.790556 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1a94fa5e-e962-44f8-a570-bf99e32397dd tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 404 len: 111 microversion: 2.20 time: 0.043005 Sep 22 22:22:46.791594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 552/1066] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:46 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 22:22:46.802029 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cc6c0240-b97b-4ddb-9035-c4984c59d0e2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '.version_select at 0x7f405c9b4e50>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:46.823659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cc6c0240-b97b-4ddb-9035-c4984c59d0e2 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946503403" status: 204 len: 0 microversion: 2.20 time: 0.027284 Sep 22 22:22:46.824491 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 515/1067] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Sep 22 22:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946503403 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 22 22:22:47.349197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:47.349899 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:47.355796 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:47.356461 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:47.356889 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:47.357616 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:47.358066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:47.358485 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:47.465750 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f3aa3335-3ef6-4897-bf88-f56dc1842db9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'create', calling method: .version_select at 0x7f405ca9bca0>, body: {"keypair": {"name": "tempest-keypair-965768241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe/uxlzCEsjvoolBLBuIpkkVqTFLr2aY99P2IlmdbH0YGCWnrRQFdEdPcAsgwTfjqA5iCuBxyUIQn3X/+o8CqwyHb3rwqsaC9phy0WRHfn0a+mmWGoTqV+x+1FTyFu0Iw=="}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:22:47.482334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-f3aa3335-3ef6-4897-bf88-f56dc1842db9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Getting quotas for project eaff29c3c9b84929b0451e8e82caf4f2. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:22:47.486803 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-f3aa3335-3ef6-4897-bf88-f56dc1842db9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Getting quotas for user 1b01f21ffa814a5da3873e5387938b2a and project eaff29c3c9b84929b0451e8e82caf4f2. Resources: {'key_pairs'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:22:47.492935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:47.500468 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-27624e93-303f-4f97-ae5c-e266a8eae0e4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1314 microversion: 2.1 time: 0.155436 Sep 22 22:22:47.501029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 553/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:47 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:47.513337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f3aa3335-3ef6-4897-bf88-f56dc1842db9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051440 Sep 22 22:22:47.513959 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 516/1069] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Sep 22 22:22:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 22 22:22:48.375129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c2cceb2f-8046-48db-8d41-07d4b6e7d43c req-4944d9fd-11a8-4ef6-a399-ef0ffd4cc1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b", "name": "network-vif-plugged", "status": "completed", "tag": "6a2dc51e-104b-4cdd-a84e-a105cd734a77"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:22:48.392832 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:48.402937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c2cceb2f-8046-48db-8d41-07d4b6e7d43c req-4944d9fd-11a8-4ef6-a399-ef0ffd4cc1de service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:48.403645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c2cceb2f-8046-48db-8d41-07d4b6e7d43c req-4944d9fd-11a8-4ef6-a399-ef0ffd4cc1de service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:48.405040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c2cceb2f-8046-48db-8d41-07d4b6e7d43c req-4944d9fd-11a8-4ef6-a399-ef0ffd4cc1de service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:48.419878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c2cceb2f-8046-48db-8d41-07d4b6e7d43c req-4944d9fd-11a8-4ef6-a399-ef0ffd4cc1de service nova] Creating event network-vif-plugged:6a2dc51e-104b-4cdd-a84e-a105cd734a77 for instance f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b on hv-cinder-84914 Sep 22 22:22:48.426994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-c2cceb2f-8046-48db-8d41-07d4b6e7d43c req-4944d9fd-11a8-4ef6-a399-ef0ffd4cc1de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055724 Sep 22 22:22:48.428245 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 554/1070] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:22:48.523925 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:48.524711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:48.526873 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:48.534848 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:48.535573 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:48.536346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:48.537350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:48.537972 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:48.538391 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:48.878600 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:48.886787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-52e51299-6f2e-4ab0-99b3-cc3d7b352d43 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1314 microversion: 2.1 time: 0.366810 Sep 22 22:22:48.887560 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 517/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:48 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:49.027603 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-731026794", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3032908-0d20-4083-a609-def5ad9a09dd"}], "security_groups": [{"name": "tempest-securitygroup--1943461209"}], "key_name": "tempest-keypair-965768241", "user_data": "}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:22:49.130281 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] validate_networks() for [('a3032908-0d20-4083-a609-def5ad9a09dd', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:22:49.599964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:22:49.600526 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:22:49.600849 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:22:49.601288 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:22:49.601736 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:22:49.611343 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:49.611830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:49.612264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:49.612995 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:49.613475 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:49.613904 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:49.631977 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Getting quotas for project eaff29c3c9b84929b0451e8e82caf4f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:22:49.636052 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Getting quotas for user 1b01f21ffa814a5da3873e5387938b2a and project eaff29c3c9b84929b0451e8e82caf4f2. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:22:49.648488 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:22:49.650947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:22:49.700796 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e9ce7aea-d790-4bb4-bffd-51c53dbdb81c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.677841 Sep 22 22:22:49.701471 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 555/1072] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Sep 22 22:22:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 22 22:22:49.712416 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1ca13660-904c-4e8e-9c56-9f8b425ee770 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:49.713028 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1ca13660-904c-4e8e-9c56-9f8b425ee770 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:49.767845 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ca13660-904c-4e8e-9c56-9f8b425ee770 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:49.778729 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ca13660-904c-4e8e-9c56-9f8b425ee770 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:49.780246 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ca13660-904c-4e8e-9c56-9f8b425ee770 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:49.781771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1ca13660-904c-4e8e-9c56-9f8b425ee770 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1280 microversion: 2.20 time: 0.073210 Sep 22 22:22:49.783030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 518/1073] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:49 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:49.911356 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:49.911975 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:49.918844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:49.919331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:49.919799 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:49.920470 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:49.920982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:49.921389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:50.078854 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:50.087835 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-84877e9f-b2a9-4748-8690-0a576c20c3b4 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1314 microversion: 2.1 time: 0.181240 Sep 22 22:22:50.103163 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 556/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:49 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:50.809161 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:50.809768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:50.817902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:50.818385 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:50.818822 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:50.819513 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:50.819963 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:50.820381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:50.891657 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:50.908408 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:50.910484 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:50.911902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2b2fad38-abfe-4031-852a-32fa72a3842b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1276 microversion: 2.20 time: 0.106637 Sep 22 22:22:50.912460 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 519/1075] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:50 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:51.111823 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:51.113135 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:51.120035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:51.120528 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:51.120973 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:51.121754 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:51.122242 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:51.122656 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:51.255863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:51.263510 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-66e13664-abfe-4aa2-90ad-afe150f9fb95 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1499 microversion: 2.1 time: 0.156627 Sep 22 22:22:51.264081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 557/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:51 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1499 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:51.800428 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:51.801136 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:51.821730 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:51.822437 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:51.822671 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:51.823418 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:51.823993 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:51.824325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:51.854333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:22:51.938653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:51.940190 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:51.949921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:51.950417 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:51.951130 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:51.954029 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-94b27f08-643a-4cc5-b51d-6349b5d81f21 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 204 len: 0 microversion: 2.1 time: 0.158108 Sep 22 22:22:51.954623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 520/1077] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:22:51 2022] DELETE /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:22:51.955286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:51.956028 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:51.956634 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:51.966222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:51.966948 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:51.973663 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:51.974147 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:51.974582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:51.975283 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:51.975732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:51.976148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:52.353157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:52.365186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:52.367817 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:52.369376 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0cfb5642-2f25-4454-84f8-24874372f047 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1338 microversion: 2.20 time: 0.435537 Sep 22 22:22:52.370413 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 558/1078] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:51 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1338 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:52.457911 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:52.469795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c6145eee-b449-4558-907a-193250f1acae tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1505 microversion: 2.1 time: 0.510293 Sep 22 22:22:52.470403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 521/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:51 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1505 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:22:53.395156 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:53.395792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:53.402300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:53.402789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:53.403229 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:53.403929 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:53.404387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:53.404818 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:53.408941 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:53.493774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:53.494595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:53.502684 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:53.503388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:53.504383 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:53.510558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:53.511178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:53.511720 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:53.672817 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:53.682221 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:53.683832 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:53.685094 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b301f4c2-4378-4d4a-86e2-d7b86f49ad46 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1406 microversion: 2.20 time: 0.293970 Sep 22 22:22:53.697389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 559/1080] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:53 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:22:53.761413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:53.769228 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:22:53.772727 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-27468d89-b8d0-48db-a4a3-bf8768e2306c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1505 microversion: 2.1 time: 0.283056 Sep 22 22:22:53.780785 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 522/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:53 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:53.940405 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-fae495a3-5ea6-4b2f-a7e7-969965e2b7b6 req-bf2fa228-4c2f-4c52-b55f-386bd6da9235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66df723f-5a3d-4e8d-892e-c04622d4f50f", "tag": "6109b39c-b3b8-4d3e-b43e-90fe65c142f8"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:22:53.952038 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-fae495a3-5ea6-4b2f-a7e7-969965e2b7b6 req-bf2fa228-4c2f-4c52-b55f-386bd6da9235 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:53.952746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-fae495a3-5ea6-4b2f-a7e7-969965e2b7b6 req-bf2fa228-4c2f-4c52-b55f-386bd6da9235 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:53.953435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-fae495a3-5ea6-4b2f-a7e7-969965e2b7b6 req-bf2fa228-4c2f-4c52-b55f-386bd6da9235 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:53.968548 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-fae495a3-5ea6-4b2f-a7e7-969965e2b7b6 req-bf2fa228-4c2f-4c52-b55f-386bd6da9235 service nova] Creating event network-changed:6109b39c-b3b8-4d3e-b43e-90fe65c142f8 for instance 66df723f-5a3d-4e8d-892e-c04622d4f50f on hv-cinder-84914 Sep 22 22:22:53.974250 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-fae495a3-5ea6-4b2f-a7e7-969965e2b7b6 req-bf2fa228-4c2f-4c52-b55f-386bd6da9235 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039267 Sep 22 22:22:53.974858 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 560/1082] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:22:54.395260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-9ee52c6e-592c-4185-a6fb-3f7aa54189ab req-1154128d-18b4-4e7e-817c-34e5f600258f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b", "name": "network-vif-deleted", "tag": "6a2dc51e-104b-4cdd-a84e-a105cd734a77"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:22:54.405763 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-9ee52c6e-592c-4185-a6fb-3f7aa54189ab req-1154128d-18b4-4e7e-817c-34e5f600258f service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:54.406387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-9ee52c6e-592c-4185-a6fb-3f7aa54189ab req-1154128d-18b4-4e7e-817c-34e5f600258f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:54.406839 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-9ee52c6e-592c-4185-a6fb-3f7aa54189ab req-1154128d-18b4-4e7e-817c-34e5f600258f service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:54.419293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-9ee52c6e-592c-4185-a6fb-3f7aa54189ab req-1154128d-18b4-4e7e-817c-34e5f600258f service nova] Creating event network-vif-deleted:6a2dc51e-104b-4cdd-a84e-a105cd734a77 for instance f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b on hv-cinder-84914 Sep 22 22:22:54.424571 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-9ee52c6e-592c-4185-a6fb-3f7aa54189ab req-1154128d-18b4-4e7e-817c-34e5f600258f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034327 Sep 22 22:22:54.425741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 523/1083] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:22:54.712522 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:54.713229 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:54.720026 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:54.720506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:54.721083 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:54.721799 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:54.722251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:54.722670 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:54.797586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:54.798488 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:54.805280 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:54.805766 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:54.806202 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:54.806893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:54.807347 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:54.807773 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:54.841703 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:54.842263 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:54.842666 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:54.843136 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lazy-loading 'fault' on Instance uuid f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:22:54.873673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:54.882493 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:54.883937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:54.885054 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f26b1a04-b746-4fce-b892-45e018edcdf8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1406 microversion: 2.20 time: 0.176793 Sep 22 22:22:54.885657 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 561/1084] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:54 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:54.894229 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:54.901936 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d9108579-4ea6-4045-9c95-735e2331c9a2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1304 microversion: 2.1 time: 0.109097 Sep 22 22:22:54.902521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 524/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:54 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:22:55.910110 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:55.910716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:55.916858 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:55.917368 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:55.917802 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:55.918481 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:55.918933 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:55.919351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:55.923647 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:55.924390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:55.930629 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:55.931113 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:55.931548 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:55.932240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:55.932700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:55.933143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:55.964818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:55.965338 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:55.965774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:55.966223 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lazy-loading 'fault' on Instance uuid f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:22:56.013718 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:56.021828 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-632b51ba-4d9e-4b01-a7e6-e2000b9c9439 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1304 microversion: 2.1 time: 0.102008 Sep 22 22:22:56.022439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 525/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:55 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:22:56.082203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:56.090746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:56.092218 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:56.093369 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-42084ef6-0aa7-4520-8c4a-c2c279f4f65a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1406 microversion: 2.20 time: 0.187335 Sep 22 22:22:56.093928 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 562/1087] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:55 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:22:57.103094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:57.103711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:57.110208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:57.110690 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:57.111123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:57.111884 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:57.112342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:57.112763 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:57.120978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:57.121752 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:57.128470 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:57.129131 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:57.129797 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:57.130517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:57.130979 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:57.131565 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:57.145696 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:57.146186 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:57.146623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:57.147072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lazy-loading 'fault' on Instance uuid f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:22:57.197555 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:57.206050 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a150ccc0-ab5d-47e1-b089-ee59ea68f534 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 200 len: 1304 microversion: 2.1 time: 0.106215 Sep 22 22:22:57.206635 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 526/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:57 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:57.398562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:57.406659 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:57.408105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:57.409817 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-de0be846-75c8-43cc-a1da-227856f1653b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1406 microversion: 2.20 time: 0.295187 Sep 22 22:22:57.410325 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 563/1089] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:57 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:22:58.229647 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:58.230270 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:58.237785 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:58.238279 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:58.238863 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:58.239426 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:58.239888 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:58.240319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:58.253825 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] HTTP exception thrown: Instance f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b could not be found. Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Request method failure captured: Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b HTTP/1.1 Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLOAnEQQEeq_ztf4_6ui4ps9123rklKJpzObd1TSI5QmwbuhU6-cmNwJdOpF60imduzMeAqmc40jSueiVJdtnvjN0aQwgZqHT0EF497n4A1__sy0shsROY_XnPU79LBNTtO-URkZa1ofnwmXYb-EoCkfe8dm5IgbQ5GJOTzMBbSNHc-8 Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: ed0761f1f2a148ce8b55f519a13421c8 Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-VolumesActionsTest-1481854535 Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:22:58.255487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed0761f1f2a148ce8b55f519a13421c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed0761f1f2a148ce8b55f519a13421c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed0761f1f2a148ce8b55f519a13421c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed0761f1f2a148ce8b55f519a13421c8", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-VolumesActionsTest-1481854535 Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: ed0761f1f2a148ce8b55f519a13421c8 Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-VolumesActionsTest-1481854535 Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-VolumesActionsTest-1481854535-project Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 59d6a1d6b9bc4daf8542b58cf62fff1a Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-VolumesActionsTest-1481854535-project Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b could not be found. Sep 22 22:22:58.256854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': 'f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b'} Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b could not be found. Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:22:58.257699 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b could not be found. Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b could not be found. Sep 22 22:22:58.258988 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:22:58.261434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Returning 404 to user: Instance f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:22:58.261434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8783f743-3c03-4bc0-9dc1-f2ff0153b955 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b" status: 404 len: 111 microversion: 2.1 time: 0.031182 Sep 22 22:22:58.261434 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 527/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:58 2022] GET /compute/v2.1/servers/f36b52a0-b1a0-487a-84b3-8c20f7e3bc6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:22:58.359224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-931785406", "imageRef": "f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0", "flavorRef": "452", "networks": [{"uuid": "0988fd66-6f7a-4942-ab4d-2ae3bc59d161"}]}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:22:58.413184 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.network.neutron [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] validate_networks() for [('0988fd66-6f7a-4942-ab4d-2ae3bc59d161', None, None, None, None, None)] {{(pid=120663) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:22:58.435746 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:58.436286 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:58.442662 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:58.443148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:58.443593 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:58.444295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:58.444779 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:58.445233 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:58.639864 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:58.648724 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:58.650186 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:58.651297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e3f63737-cbb2-4ee6-b450-7be167b7e238 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1406 microversion: 2.20 time: 0.219548 Sep 22 22:22:58.651846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 528/1091] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:58 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:22:58.823101 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Flavor limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:22:58.823529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Image limits 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:22:58.824009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Flavor pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:22:58.824423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Image pref 0:0:0 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:22:58.824891 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.virt.hardware [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:22:58.833713 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:58.834201 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:58.834640 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:58.835374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:58.835829 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:58.836255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:58.853866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Getting quotas for project ed0761f1f2a148ce8b55f519a13421c8. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:22:58.857856 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Getting quotas for user 59d6a1d6b9bc4daf8542b58cf62fff1a and project ed0761f1f2a148ce8b55f519a13421c8. Resources: {'ram', 'cores', 'instances'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:22:58.869394 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Going to run 1 instances... {{(pid=120663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:22:58.871698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a984bb-e9f3-4da0-83e6-f3f7b6ed08a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:22:58.917212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bc7bf8e6-004c-4b1f-a80e-3d44041ec1af tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561795 Sep 22 22:22:58.917866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 564/1092] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:22:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:22:58.929569 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bf2c162d-7a9a-4afc-9980-2d481e511378 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:58.930177 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bf2c162d-7a9a-4afc-9980-2d481e511378 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:58.983729 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bf2c162d-7a9a-4afc-9980-2d481e511378 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:58.992711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bf2c162d-7a9a-4afc-9980-2d481e511378 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1213 microversion: 2.1 time: 0.066884 Sep 22 22:22:58.993346 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 529/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:22:58 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:22:59.677039 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:22:59.677794 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:22:59.684483 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:59.684964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:59.685430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:59.686124 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:22:59.686579 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:22:59.687007 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:22:59.819365 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:59.827435 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:59.828897 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:22:59.830048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-31b642a4-b77d-4b2a-9297-c399b3362d9c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1406 microversion: 2.20 time: 0.157760 Sep 22 22:22:59.831212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 565/1094] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:22:59 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:23:00.016787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:00.017446 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:00.026446 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:00.026936 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:00.027372 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:00.028074 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:00.028528 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:00.028948 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:00.143826 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:00.158116 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-6867fd01-2efb-4adc-8eb7-6eae3d3a00ba tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1273 microversion: 2.1 time: 0.145467 Sep 22 22:23:00.159577 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 530/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:00 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:00.252251 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-43fe9229-7390-49aa-a28c-3b34e89cde24 req-118f2d8a-9178-4d05-9be7-1a8568da23fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df723f-5a3d-4e8d-892e-c04622d4f50f", "name": "network-vif-plugged", "status": "completed", "tag": "6109b39c-b3b8-4d3e-b43e-90fe65c142f8"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:23:00.263681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-43fe9229-7390-49aa-a28c-3b34e89cde24 req-118f2d8a-9178-4d05-9be7-1a8568da23fb service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:00.264456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-43fe9229-7390-49aa-a28c-3b34e89cde24 req-118f2d8a-9178-4d05-9be7-1a8568da23fb service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:00.265032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-43fe9229-7390-49aa-a28c-3b34e89cde24 req-118f2d8a-9178-4d05-9be7-1a8568da23fb service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:00.278274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-43fe9229-7390-49aa-a28c-3b34e89cde24 req-118f2d8a-9178-4d05-9be7-1a8568da23fb service nova] Creating event network-vif-plugged:6109b39c-b3b8-4d3e-b43e-90fe65c142f8 for instance 66df723f-5a3d-4e8d-892e-c04622d4f50f on hv-cinder-84914 Sep 22 22:23:00.283345 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-43fe9229-7390-49aa-a28c-3b34e89cde24 req-118f2d8a-9178-4d05-9be7-1a8568da23fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035758 Sep 22 22:23:00.284472 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 566/1096] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:23:00.859233 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:00.859874 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:00.863257 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:00.867533 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:00.868020 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:00.868461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:00.869184 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:00.869647 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:00.870076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:01.002374 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:01.010980 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:01.012419 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:01.013550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-42e88a98-a824-4541-b53e-734227a3c03a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1406 microversion: 2.20 time: 0.158260 Sep 22 22:23:01.014102 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 531/1097] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:23:00 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:23:01.186048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:01.186855 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:01.194740 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:01.195231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:01.195674 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:01.196380 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:01.196842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:01.197306 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:01.409049 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:01.417374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-39a16530-dc8e-4e86-a1ac-4cf6e252e43c tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.235915 Sep 22 22:23:01.417957 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 567/1098] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:01 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:01.787361 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-cff4e688-eab3-4beb-b46c-e5e3794e1f91 req-d86cce9f-9356-40f9-a442-593f30b657b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d93567-e72a-41aa-a736-b6f6fab53269", "tag": "112c4980-6883-45bb-9b35-5748b395c8e9"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:23:01.797531 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-cff4e688-eab3-4beb-b46c-e5e3794e1f91 req-d86cce9f-9356-40f9-a442-593f30b657b5 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:01.798018 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-cff4e688-eab3-4beb-b46c-e5e3794e1f91 req-d86cce9f-9356-40f9-a442-593f30b657b5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:01.798997 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-cff4e688-eab3-4beb-b46c-e5e3794e1f91 req-d86cce9f-9356-40f9-a442-593f30b657b5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:01.810475 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-cff4e688-eab3-4beb-b46c-e5e3794e1f91 req-d86cce9f-9356-40f9-a442-593f30b657b5 service nova] Creating event network-changed:112c4980-6883-45bb-9b35-5748b395c8e9 for instance 68d93567-e72a-41aa-a736-b6f6fab53269 on hv-cinder-84914 Sep 22 22:23:01.815525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-cff4e688-eab3-4beb-b46c-e5e3794e1f91 req-d86cce9f-9356-40f9-a442-593f30b657b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032388 Sep 22 22:23:01.816123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 532/1099] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:23:02.038719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:02.039327 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:02.045273 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:02.045755 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:02.046190 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:02.046874 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:02.047327 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:02.047756 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:02.179240 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:02.187564 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:02.189134 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:02.191176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-03006e52-158f-404c-be1a-f24d493024d5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1406 microversion: 2.20 time: 0.155509 Sep 22 22:23:02.191748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 568/1100] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:23:02 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:23:02.442373 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:02.442985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:02.449148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:02.449638 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:02.450074 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:02.450761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:02.451217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:02.451640 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:02.623967 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:02.632525 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e407bdab-9413-49cd-abc5-ca300691eca8 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.195382 Sep 22 22:23:02.633126 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 533/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:02 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:03.216553 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:03.217264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:03.223844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:03.224326 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:03.224757 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:03.225470 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:03.225920 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:03.226334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:03.359074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:03.367694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:03.369183 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:03.370470 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-11abbe42-1b80-4532-8b49-e22851532d03 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1599 microversion: 2.20 time: 0.158258 Sep 22 22:23:03.371045 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 569/1102] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:23:03 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:23:03.394674 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d2ac87fb-d604-490f-a615-1996c3e8cc5a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:03.395176 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d2ac87fb-d604-490f-a615-1996c3e8cc5a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:03.401400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2ac87fb-d604-490f-a615-1996c3e8cc5a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:03.401885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2ac87fb-d604-490f-a615-1996c3e8cc5a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:03.402315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2ac87fb-d604-490f-a615-1996c3e8cc5a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:03.403004 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2ac87fb-d604-490f-a615-1996c3e8cc5a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:03.403458 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2ac87fb-d604-490f-a615-1996c3e8cc5a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:03.403888 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d2ac87fb-d604-490f-a615-1996c3e8cc5a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:03.478973 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d2ac87fb-d604-490f-a615-1996c3e8cc5a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088095 Sep 22 22:23:03.479814 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 534/1103] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Sep 22 22:23:03 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:23:03.655649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:03.656298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:03.662972 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:03.663523 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:03.663957 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:03.664643 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:03.665095 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:03.665544 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:03.906629 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:03.914607 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1ceb589b-e9c6-40b6-b29d-e359bcc39716 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.262880 Sep 22 22:23:03.915175 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 570/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:03 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:04.487552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-2062570d-3272-4cb8-9dc2-35c7e8f8db81 req-5ee2573f-b7fe-4005-9472-85a236ab7e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66df723f-5a3d-4e8d-892e-c04622d4f50f", "tag": "6109b39c-b3b8-4d3e-b43e-90fe65c142f8"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:23:04.496876 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2062570d-3272-4cb8-9dc2-35c7e8f8db81 req-5ee2573f-b7fe-4005-9472-85a236ab7e17 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:04.497388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2062570d-3272-4cb8-9dc2-35c7e8f8db81 req-5ee2573f-b7fe-4005-9472-85a236ab7e17 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:04.497817 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-2062570d-3272-4cb8-9dc2-35c7e8f8db81 req-5ee2573f-b7fe-4005-9472-85a236ab7e17 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:04.509651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-2062570d-3272-4cb8-9dc2-35c7e8f8db81 req-5ee2573f-b7fe-4005-9472-85a236ab7e17 service nova] Creating event network-changed:6109b39c-b3b8-4d3e-b43e-90fe65c142f8 for instance 66df723f-5a3d-4e8d-892e-c04622d4f50f on hv-cinder-84914 Sep 22 22:23:04.514638 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-2062570d-3272-4cb8-9dc2-35c7e8f8db81 req-5ee2573f-b7fe-4005-9472-85a236ab7e17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031510 Sep 22 22:23:04.515399 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 535/1105] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:23:04.938021 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:04.938767 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:04.945860 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:04.946351 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:04.946784 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:04.947482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:04.947940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:04.948359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:05.096924 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:05.104884 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6fb517a9-3db1-46d7-95c5-be2076f818db tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.170776 Sep 22 22:23:05.105484 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 571/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:04 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:23:06.127903 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:06.129390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:06.135900 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:06.136387 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:06.136823 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:06.137533 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:06.138105 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:06.138543 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:06.285069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:06.293022 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2164747d-0099-4122-bb29-aa5a2377d049 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.169282 Sep 22 22:23:06.293655 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 536/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:06 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:07.319953 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:07.320505 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:07.323991 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:07.327766 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:07.328246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:07.328678 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:07.329392 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:07.329842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:07.330264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:07.459389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:07.466957 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-bd985b53-f992-4e10-8ab8-4e9e26083d79 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.152355 Sep 22 22:23:07.467521 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 572/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:07 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:08.490910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:08.491446 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:08.497382 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:08.497857 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:08.498289 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:08.498969 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:08.499422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:08.499838 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:08.633126 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:08.640820 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-4b648166-893a-49c7-a081-ec9e15bb6185 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.154629 Sep 22 22:23:08.641397 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 537/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:08 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:09.663609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:09.664225 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:09.666529 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:09.667186 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=12 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:09.672908 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:09.673419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:09.673861 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:09.674540 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:09.674995 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:09.675418 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:09.808191 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:09.815914 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0b6f7a4b-28cb-4a34-9a9e-1b905aeb608a tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.156568 Sep 22 22:23:09.816746 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 573/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:09 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:10.419630 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-5f110ed9-0fdb-40c0-bebf-9949c2e599ec req-afdf7269-2774-41f9-9ccc-3eae849ad928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d93567-e72a-41aa-a736-b6f6fab53269", "name": "network-vif-plugged", "status": "completed", "tag": "112c4980-6883-45bb-9b35-5748b395c8e9"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:23:10.424625 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=14 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:10.431307 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5f110ed9-0fdb-40c0-bebf-9949c2e599ec req-afdf7269-2774-41f9-9ccc-3eae849ad928 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:10.433086 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5f110ed9-0fdb-40c0-bebf-9949c2e599ec req-afdf7269-2774-41f9-9ccc-3eae849ad928 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:10.433086 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-5f110ed9-0fdb-40c0-bebf-9949c2e599ec req-afdf7269-2774-41f9-9ccc-3eae849ad928 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:10.443702 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-5f110ed9-0fdb-40c0-bebf-9949c2e599ec req-afdf7269-2774-41f9-9ccc-3eae849ad928 service nova] Creating event network-vif-plugged:112c4980-6883-45bb-9b35-5748b395c8e9 for instance 68d93567-e72a-41aa-a736-b6f6fab53269 on hv-cinder-84914 Sep 22 22:23:10.448516 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-5f110ed9-0fdb-40c0-bebf-9949c2e599ec req-afdf7269-2774-41f9-9ccc-3eae849ad928 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032519 Sep 22 22:23:10.449150 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 538/1111] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:23:10.840052 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:10.840658 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:10.847526 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:10.848002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:10.848464 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:10.849269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:10.849724 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:10.850150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:10.977081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:10.986165 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-390d617e-d0c5-4789-9bca-7cfb031e0e82 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.149795 Sep 22 22:23:10.986739 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 574/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:10 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:12.008784 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:12.009583 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:12.015694 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:12.016178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:12.016613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:12.017339 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:12.017795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:12.018217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:12.152467 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:12.160127 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bd879ce0-fad0-4717-93ef-a134c3952f93 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1313 microversion: 2.1 time: 0.156040 Sep 22 22:23:12.160660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 539/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:12 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:13.183386 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:13.183998 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:13.190282 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:13.190777 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:13.191216 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:13.192166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:13.192618 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:13.193042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:13.318833 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:13.326991 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a71a7af5-a20c-451a-98e7-cd2c3900f0ea tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1498 microversion: 2.1 time: 0.148255 Sep 22 22:23:13.327562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 575/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:13 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:13.879608 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:13.880097 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:13.887076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:13.887556 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:13.887990 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:13.888678 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:13.889146 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:13.889573 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:13.915058 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:23:13.987106 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c0e4e7e8-f469-4093-954c-af38a61514f2 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 204 len: 0 microversion: 2.1 time: 0.111018 Sep 22 22:23:13.987653 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 540/1115] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:23:13 2022] DELETE /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:23:13.997462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:13.998368 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:14.004314 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:14.004791 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:14.005281 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:14.005965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:14.006447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:14.006866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:14.136144 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:14.143732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fe3b17dc-29de-47a2-b74a-6cfc07cdf8aa tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1504 microversion: 2.1 time: 0.150938 Sep 22 22:23:14.144298 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 576/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:13 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:23:15.168464 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:15.169088 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:15.175790 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:15.176271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:15.176700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:15.177423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:15.177877 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:15.178297 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:15.197161 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:15.309424 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:15.317401 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-7fdbccde-f1a6-46d2-be61-0c1ce25435da tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1504 microversion: 2.1 time: 0.153727 Sep 22 22:23:15.317969 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 541/1117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:15 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:16.250310 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-c37026d6-8b4b-4f4c-b5a0-3c290c0d7690 req-788c93cd-a7bb-4d58-8a7c-2dbd8c44d50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d93567-e72a-41aa-a736-b6f6fab53269", "name": "network-vif-deleted", "tag": "112c4980-6883-45bb-9b35-5748b395c8e9"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:23:16.261732 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c37026d6-8b4b-4f4c-b5a0-3c290c0d7690 req-788c93cd-a7bb-4d58-8a7c-2dbd8c44d50a service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:16.262199 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c37026d6-8b4b-4f4c-b5a0-3c290c0d7690 req-788c93cd-a7bb-4d58-8a7c-2dbd8c44d50a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:16.262622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-c37026d6-8b4b-4f4c-b5a0-3c290c0d7690 req-788c93cd-a7bb-4d58-8a7c-2dbd8c44d50a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:16.277266 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-c37026d6-8b4b-4f4c-b5a0-3c290c0d7690 req-788c93cd-a7bb-4d58-8a7c-2dbd8c44d50a service nova] Creating event network-vif-deleted:112c4980-6883-45bb-9b35-5748b395c8e9 for instance 68d93567-e72a-41aa-a736-b6f6fab53269 on hv-cinder-84914 Sep 22 22:23:16.283119 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-c37026d6-8b4b-4f4c-b5a0-3c290c0d7690 req-788c93cd-a7bb-4d58-8a7c-2dbd8c44d50a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036561 Sep 22 22:23:16.283714 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 577/1118] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:23:16.342030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:16.342790 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:16.349997 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:16.350564 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:16.351594 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:16.352441 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:16.353003 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:16.353538 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:16.384393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:16.384798 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:16.385265 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:16.385706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lazy-loading 'fault' on Instance uuid 68d93567-e72a-41aa-a736-b6f6fab53269 {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:23:16.427768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d6a1d6b9bc4daf8542b58cf62fff1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0761f1f2a148ce8b55f519a13421c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:16.436045 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8d7d04e9-99c2-4267-a4e1-902b75b917de tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 200 len: 1303 microversion: 2.1 time: 0.098145 Sep 22 22:23:16.436623 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 542/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:16 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:17.460510 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:17.461258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] [instance: 68d93567-e72a-41aa-a736-b6f6fab53269] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:17.467909 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:17.468395 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:17.468835 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:17.469570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:17.470042 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:17.470473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:17.484014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] HTTP exception thrown: Instance 68d93567-e72a-41aa-a736-b6f6fab53269 could not be found. Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Request method failure captured: Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 HTTP/1.1 Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLOAnEQQEeq_ztf4_6ui4ps9123rklKJpzObd1TSI5QmwbuhU6-cmNwJdOpF60imduzMeAqmc40jSueiVJdtnvjN0aQwgZqHT0EF497n4A1__sy0shsROY_XnPU79LBNTtO-URkZa1ofnwmXYb-EoCkfe8dm5IgbQ5GJOTzMBbSNHc-8 Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: ed0761f1f2a148ce8b55f519a13421c8 Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-VolumesActionsTest-1481854535 Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:23:17.485707 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed0761f1f2a148ce8b55f519a13421c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed0761f1f2a148ce8b55f519a13421c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed0761f1f2a148ce8b55f519a13421c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed0761f1f2a148ce8b55f519a13421c8", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-VolumesActionsTest-1481854535 Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: ed0761f1f2a148ce8b55f519a13421c8 Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-VolumesActionsTest-1481854535 Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-VolumesActionsTest-1481854535-project Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 59d6a1d6b9bc4daf8542b58cf62fff1a Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-VolumesActionsTest-1481854535-project Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 68d93567-e72a-41aa-a736-b6f6fab53269 could not be found. Sep 22 22:23:17.487197 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '68d93567-e72a-41aa-a736-b6f6fab53269'} Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d93567-e72a-41aa-a736-b6f6fab53269 could not be found. Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:23:17.487999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d93567-e72a-41aa-a736-b6f6fab53269 could not be found. Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d93567-e72a-41aa-a736-b6f6fab53269 could not be found. Sep 22 22:23:17.489744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:23:17.491337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] Returning 404 to user: Instance 68d93567-e72a-41aa-a736-b6f6fab53269 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:23:17.491337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-12a37362-721b-4a10-8e5e-d80813296ef7 tempest-VolumesActionsTest-1481854535 tempest-VolumesActionsTest-1481854535-project] 10.222.0.25 "GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269" status: 404 len: 111 microversion: 2.1 time: 0.030888 Sep 22 22:23:17.491337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 578/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:17 2022] GET /compute/v2.1/servers/68d93567-e72a-41aa-a736-b6f6fab53269 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:23:55.621300 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:55.622078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-91560164-36af-40fd-a30a-0fa82f47fcd6 req-e1a4d2a9-2455-42ab-8ec0-e954d2b6cd47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2feb92db-975d-4abf-8814-603da11f8603", "tag": "2f531c40-7605-4ab0-bed8-8a0000e6cd28"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:23:55.622522 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:55.625780 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:55.626431 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=10 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:55.627928 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=12 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:55.628813 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=98 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:23:55.630414 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:55.630932 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:55.631407 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:55.632136 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:55.632593 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:55.633271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:55.634892 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-91560164-36af-40fd-a30a-0fa82f47fcd6 req-e1a4d2a9-2455-42ab-8ec0-e954d2b6cd47 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:55.635399 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-91560164-36af-40fd-a30a-0fa82f47fcd6 req-e1a4d2a9-2455-42ab-8ec0-e954d2b6cd47 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:55.635921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-91560164-36af-40fd-a30a-0fa82f47fcd6 req-e1a4d2a9-2455-42ab-8ec0-e954d2b6cd47 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:55.648398 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-91560164-36af-40fd-a30a-0fa82f47fcd6 req-e1a4d2a9-2455-42ab-8ec0-e954d2b6cd47 service nova] Creating event network-changed:2f531c40-7605-4ab0-bed8-8a0000e6cd28 for instance 2feb92db-975d-4abf-8814-603da11f8603 on hv-cinder-84914 Sep 22 22:23:55.654524 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-91560164-36af-40fd-a30a-0fa82f47fcd6 req-e1a4d2a9-2455-42ab-8ec0-e954d2b6cd47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036366 Sep 22 22:23:55.655935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 579/1121] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:23:55.663710 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:23:55.778618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ef875045-05e7-4aa0-8e1c-c5b11fa4297e tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 204 len: 0 microversion: 2.1 time: 0.161526 Sep 22 22:23:55.779213 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 543/1122] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:23:55 2022] DELETE /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:23:55.788258 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:55.788960 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:55.795420 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:55.796308 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:55.796690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:55.797610 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:55.798075 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:55.798494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:55.937020 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:55.945229 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b4148924-8919-4450-a4b3-73fe773b1160 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1576 microversion: 2.1 time: 0.161271 Sep 22 22:23:55.945803 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 580/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:55 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:56.970552 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:56.971388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:56.978226 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:56.978977 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:56.980262 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:56.981058 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:56.981646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:56.982225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:57.131094 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:57.140875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b100d0dd-60ef-4c8a-be8c-dde1ca980b3f tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1576 microversion: 2.1 time: 0.174649 Sep 22 22:23:57.141633 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 544/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:56 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:58.163923 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:58.164649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:58.171940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:58.172429 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:58.172865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:58.173645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:58.174473 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:58.175087 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:58.311074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:58.318985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-40de6a02-2db1-45fc-8619-4ee1c649b6f5 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1458 microversion: 2.1 time: 0.158967 Sep 22 22:23:58.319645 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 581/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:58 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:23:58.502817 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-ca6754b6-1a6f-4b1f-bf52-71885c4886a3 req-a679b85e-2ca0-4436-ab86-2234aff8fd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2feb92db-975d-4abf-8814-603da11f8603", "name": "network-vif-deleted", "tag": "2f531c40-7605-4ab0-bed8-8a0000e6cd28"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:23:58.513123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ca6754b6-1a6f-4b1f-bf52-71885c4886a3 req-a679b85e-2ca0-4436-ab86-2234aff8fd2e service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:58.513530 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ca6754b6-1a6f-4b1f-bf52-71885c4886a3 req-a679b85e-2ca0-4436-ab86-2234aff8fd2e service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:58.513956 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-ca6754b6-1a6f-4b1f-bf52-71885c4886a3 req-a679b85e-2ca0-4436-ab86-2234aff8fd2e service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:58.525632 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-ca6754b6-1a6f-4b1f-bf52-71885c4886a3 req-a679b85e-2ca0-4436-ab86-2234aff8fd2e service nova] Creating event network-vif-deleted:2f531c40-7605-4ab0-bed8-8a0000e6cd28 for instance 2feb92db-975d-4abf-8814-603da11f8603 on hv-cinder-84914 Sep 22 22:23:58.530998 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-ca6754b6-1a6f-4b1f-bf52-71885c4886a3 req-a679b85e-2ca0-4436-ab86-2234aff8fd2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031930 Sep 22 22:23:58.531587 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 545/1126] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:23:59.343374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:23:59.343981 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:23:59.350246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:59.350759 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:59.351191 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:59.351904 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:59.352350 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:59.352774 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:59.383671 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:23:59.384146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:23:59.384572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:23:59.385014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lazy-loading 'fault' on Instance uuid 2feb92db-975d-4abf-8814-603da11f8603 {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:23:59.425263 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:23:59.432910 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fdd4f96e-c1ea-49dd-b3f9-898abfd6e76c tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 200 len: 1231 microversion: 2.1 time: 0.094167 Sep 22 22:23:59.433503 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 582/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:23:59 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:24:00.456420 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:00.457152 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: 2feb92db-975d-4abf-8814-603da11f8603] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:00.463283 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:00.463875 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:00.464260 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:00.465150 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:00.465618 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:00.466049 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:00.479008 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] HTTP exception thrown: Instance 2feb92db-975d-4abf-8814-603da11f8603 could not be found. Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Request method failure captured: Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 HTTP/1.1 Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN5fB_4_ew08rsyhBLN9O6VJu31nmwQS0LA3oE33R_nNZFMHJj7Tw72cGdsUZP9h0qRuDkNnTAV_OMVKZmOYOH6L_A-eyb1uThZIqzBGKqZZ3Q7Iyp9I2IgBLMk06q5qwb0nIMPOWBijmVc3llIYZbAE9CaP_fyvNx-HTItTupueFd4 Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:24:00.481342 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9c311fa04f241249d428df8e88539f4", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: cc89baeb82444da78312c4b0b3fb0c41 Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 2feb92db-975d-4abf-8814-603da11f8603 could not be found. Sep 22 22:24:00.483175 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '2feb92db-975d-4abf-8814-603da11f8603'} Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2feb92db-975d-4abf-8814-603da11f8603 could not be found. Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:24:00.484165 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2feb92db-975d-4abf-8814-603da11f8603 could not be found. Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2feb92db-975d-4abf-8814-603da11f8603 could not be found. Sep 22 22:24:00.485854 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:00.487217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Returning 404 to user: Instance 2feb92db-975d-4abf-8814-603da11f8603 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:24:00.487217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0ea2a788-08ec-46b0-98e5-340e8d37d2a1 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603" status: 404 len: 111 microversion: 2.1 time: 0.031055 Sep 22 22:24:00.487217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 546/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:24:00 2022] GET /compute/v2.1/servers/2feb92db-975d-4abf-8814-603da11f8603 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:24:03.768913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-0a1e1fc9-18fb-402a-82f1-194a65b7a9ee req-b700df82-80b4-4fdc-adb4-81019a8ecbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbebf564-cdc8-496b-9257-1de15ce25ca5", "tag": "df43b20d-bd58-4303-8444-f7ed51aa3a97"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:24:03.775362 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:03.775869 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:03.782829 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:03.783602 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:03.784104 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:03.784709 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0a1e1fc9-18fb-402a-82f1-194a65b7a9ee req-b700df82-80b4-4fdc-adb4-81019a8ecbee service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:03.784930 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:03.785242 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0a1e1fc9-18fb-402a-82f1-194a65b7a9ee req-b700df82-80b4-4fdc-adb4-81019a8ecbee service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:03.785673 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-0a1e1fc9-18fb-402a-82f1-194a65b7a9ee req-b700df82-80b4-4fdc-adb4-81019a8ecbee service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:03.786195 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:03.786807 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:03.798154 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-0a1e1fc9-18fb-402a-82f1-194a65b7a9ee req-b700df82-80b4-4fdc-adb4-81019a8ecbee service nova] Creating event network-changed:df43b20d-bd58-4303-8444-f7ed51aa3a97 for instance fbebf564-cdc8-496b-9257-1de15ce25ca5 on hv-cinder-84914 Sep 22 22:24:03.803173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-0a1e1fc9-18fb-402a-82f1-194a65b7a9ee req-b700df82-80b4-4fdc-adb4-81019a8ecbee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037830 Sep 22 22:24:03.804204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 547/1129] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 22:24:03.815330 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:24:03.905929 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a8194a68-6201-49f4-bfba-cf264261b47d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 204 len: 0 microversion: 2.1 time: 0.143236 Sep 22 22:24:03.907030 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 583/1130] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:24:03 2022] DELETE /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:24:03.915738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:03.916475 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:03.923273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:03.923768 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:03.924208 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:03.924908 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:03.925403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:03.925836 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:04.063433 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:04.071659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-21ac566f-2318-4dd3-923f-c7f760966925 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1577 microversion: 2.1 time: 0.160122 Sep 22 22:24:04.072595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 548/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:24:03 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:24:05.096780 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:05.097739 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:05.104102 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:05.104590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:05.105031 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:05.105762 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:05.106273 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:05.106733 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:05.360665 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc89baeb82444da78312c4b0b3fb0c41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c311fa04f241249d428df8e88539f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:05.368963 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6f1fcffd-b023-49bf-90d5-c55a3842f99d tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 200 len: 1458 microversion: 2.1 time: 0.276405 Sep 22 22:24:05.369572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 584/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:24:05 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 1458 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:24:05.818258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-6a6f307f-0b2f-46f5-b529-084364420038 req-8b89ab72-5883-459c-9a2f-00a4cfe64e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbebf564-cdc8-496b-9257-1de15ce25ca5", "name": "network-vif-deleted", "tag": "df43b20d-bd58-4303-8444-f7ed51aa3a97"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:24:05.828193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6a6f307f-0b2f-46f5-b529-084364420038 req-8b89ab72-5883-459c-9a2f-00a4cfe64e4a service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:05.828674 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6a6f307f-0b2f-46f5-b529-084364420038 req-8b89ab72-5883-459c-9a2f-00a4cfe64e4a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:05.829128 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-6a6f307f-0b2f-46f5-b529-084364420038 req-8b89ab72-5883-459c-9a2f-00a4cfe64e4a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:05.839673 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-6a6f307f-0b2f-46f5-b529-084364420038 req-8b89ab72-5883-459c-9a2f-00a4cfe64e4a service nova] Creating event network-vif-deleted:df43b20d-bd58-4303-8444-f7ed51aa3a97 for instance fbebf564-cdc8-496b-9257-1de15ce25ca5 on hv-cinder-84914 Sep 22 22:24:05.844481 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-6a6f307f-0b2f-46f5-b529-084364420038 req-8b89ab72-5883-459c-9a2f-00a4cfe64e4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029931 Sep 22 22:24:05.845049 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 549/1133] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:24:06.392831 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:06.393470 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: fbebf564-cdc8-496b-9257-1de15ce25ca5] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:06.399872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:06.400383 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:06.400826 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:06.401649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:06.402841 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:06.403269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:06.416548 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] HTTP exception thrown: Instance fbebf564-cdc8-496b-9257-1de15ce25ca5 could not be found. Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Request method failure captured: Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 HTTP/1.1 Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN5fB_4_ew08rsyhBLN9O6VJu31nmwQS0LA3oE33R_nNZFMHJj7Tw72cGdsUZP9h0qRuDkNnTAV_OMVKZmOYOH6L_A-eyb1uThZIqzBGKqZZ3Q7Iyp9I2IgBLMk06q5qwb0nIMPOWBijmVc3llIYZbAE9CaP_fyvNx-HTItTupueFd4 Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:24:06.418231 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9c311fa04f241249d428df8e88539f4", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: cc89baeb82444da78312c4b0b3fb0c41 Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance fbebf564-cdc8-496b-9257-1de15ce25ca5 could not be found. Sep 22 22:24:06.420018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'fbebf564-cdc8-496b-9257-1de15ce25ca5'} Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbebf564-cdc8-496b-9257-1de15ce25ca5 could not be found. Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:24:06.421032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbebf564-cdc8-496b-9257-1de15ce25ca5 could not be found. Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbebf564-cdc8-496b-9257-1de15ce25ca5 could not be found. Sep 22 22:24:06.422681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.424204 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Returning 404 to user: Instance fbebf564-cdc8-496b-9257-1de15ce25ca5 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:24:06.424204 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-336d7ec0-d2d5-4e5d-8c59-ba543f170d27 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5" status: 404 len: 111 microversion: 2.1 time: 0.030756 Sep 22 22:24:06.424204 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 585/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:24:06 2022] GET /compute/v2.1/servers/fbebf564-cdc8-496b-9257-1de15ce25ca5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:24:06.873238 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:06.873906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:06.882068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:06.882489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:06.882927 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:06.883637 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:06.884116 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:06.884541 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:06.902941 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] HTTP exception thrown: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Request method failure captured: Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: DELETE /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c HTTP/1.1 Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN5fB_4_ew08rsyhBLN9O6VJu31nmwQS0LA3oE33R_nNZFMHJj7Tw72cGdsUZP9h0qRuDkNnTAV_OMVKZmOYOH6L_A-eyb1uThZIqzBGKqZZ3Q7Iyp9I2IgBLMk06q5qwb0nIMPOWBijmVc3llIYZbAE9CaP_fyvNx-HTItTupueFd4 Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:24:06.904617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9c311fa04f241249d428df8e88539f4", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: cc89baeb82444da78312c4b0b3fb0c41 Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.906301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': 'a9e642fd-e734-4624-b2be-6fd3141f7a8c'} Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:24:06.907954 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.909558 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.911153 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Returning 404 to user: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:24:06.911153 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-931b04ff-1c6b-4483-b4b7-9f7e8fde3bb9 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 404 len: 111 microversion: 2.1 time: 0.038016 Sep 22 22:24:06.911153 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 550/1135] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:24:06 2022] DELETE /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:24:06.914776 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:06.915447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] [instance: a9e642fd-e734-4624-b2be-6fd3141f7a8c] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:06.921524 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:06.922016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:06.922456 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:06.923160 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:06.923618 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:06.924066 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:06.938935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] HTTP exception thrown: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Request method failure captured: Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c HTTP/1.1 Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN5fB_4_ew08rsyhBLN9O6VJu31nmwQS0LA3oE33R_nNZFMHJj7Tw72cGdsUZP9h0qRuDkNnTAV_OMVKZmOYOH6L_A-eyb1uThZIqzBGKqZZ3Q7Iyp9I2IgBLMk06q5qwb0nIMPOWBijmVc3llIYZbAE9CaP_fyvNx-HTItTupueFd4 Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:24:06.940513 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e9c311fa04f241249d428df8e88539f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e9c311fa04f241249d428df8e88539f4", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: e9c311fa04f241249d428df8e88539f4 Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-TestVolumeBootPattern-899794602 Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: cc89baeb82444da78312c4b0b3fb0c41 Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-TestVolumeBootPattern-899794602-project Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.942296 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': 'a9e642fd-e734-4624-b2be-6fd3141f7a8c'} Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:24:06.943255 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. Sep 22 22:24:06.944615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:24:06.946334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Returning 404 to user: Instance a9e642fd-e734-4624-b2be-6fd3141f7a8c could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:24:06.946334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-40e8953d-2c37-46e2-a691-c82d039bcac4 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c" status: 404 len: 111 microversion: 2.1 time: 0.031024 Sep 22 22:24:06.946334 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 586/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:24:06 2022] GET /compute/v2.1/servers/a9e642fd-e734-4624-b2be-6fd3141f7a8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:24:08.245832 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-94bfeac0-4d78-433b-9d31-b5b50bb9c143 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] Calling method '.version_select at 0x7f405cbbd3a0>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:08.276551 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-94bfeac0-4d78-433b-9d31-b5b50bb9c143 tempest-TestVolumeBootPattern-899794602 tempest-TestVolumeBootPattern-899794602-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1122905243" status: 202 len: 0 microversion: 2.1 time: 0.034001 Sep 22 22:24:08.277865 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 551/1137] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Sep 22 22:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1122905243 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:24:20.448394 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:24:20.449331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:24:20.666500 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-92f0cf24-7d6c-440d-b12e-47af940a8da7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:20.667004 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-92f0cf24-7d6c-440d-b12e-47af940a8da7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:20.672969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92f0cf24-7d6c-440d-b12e-47af940a8da7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:20.673596 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92f0cf24-7d6c-440d-b12e-47af940a8da7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:20.674033 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92f0cf24-7d6c-440d-b12e-47af940a8da7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:20.674718 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92f0cf24-7d6c-440d-b12e-47af940a8da7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:20.675169 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92f0cf24-7d6c-440d-b12e-47af940a8da7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:20.675594 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-92f0cf24-7d6c-440d-b12e-47af940a8da7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:20.698179 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-92f0cf24-7d6c-440d-b12e-47af940a8da7 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/ips" status: 200 len: 153 microversion: 2.20 time: 0.254900 Sep 22 22:24:20.698783 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 587/1138] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Sep 22 22:24:20 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/ips => generated 153 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:24:22.584384 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:24:22.585851 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:24:22.590142 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:24:22.590700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:22.599376 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:22.599944 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:22.600548 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:22.601803 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:22.602612 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:22.603354 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:22.631891 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.objects.instance [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lazy-loading 'flavor' on Instance uuid 66df723f-5a3d-4e8d-892e-c04622d4f50f {{(pid=120662) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:24:22.823415 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-dd644241-a8c5-48e0-bba9-2137c345141a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/action" status: 202 len: 0 microversion: 2.20 time: 0.240118 Sep 22 22:24:22.824047 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 552/1139] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 22 22:24:22 2022] POST /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:24:22.832934 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:22.833628 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:22.840029 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:22.840443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:22.840871 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:22.841575 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:22.843111 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:22.843305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:22.975613 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:22.983983 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:22.985460 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:22.986810 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c8a095a5-6c54-4d99-af0c-2b21c45b7661 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.157767 Sep 22 22:24:22.987550 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 588/1140] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:22 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:24.014614 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:24.015579 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:24.021785 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:24.022273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:24.022715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:24.023412 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:24.023871 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:24.024298 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:24.153487 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:24.162264 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:24.163750 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:24.164915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9cfb6e0c-c42d-4023-9c91-58e0604bd4a8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.155749 Sep 22 22:24:24.165512 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 553/1141] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:24 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:25.191397 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:25.192002 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:25.198537 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:25.199018 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:25.199712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:25.200405 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:25.200853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:25.201842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:25.328287 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:25.336328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:25.337813 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:25.338976 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-3ef43d3b-a0b3-4e59-a57d-e5455f157b1b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.151560 Sep 22 22:24:25.339539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 589/1142] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:25 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:24:26.367833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:26.368388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:26.375753 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:26.376235 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:26.376664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:26.377374 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:26.377824 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:26.378258 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:26.508666 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:26.517369 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:26.518799 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:26.519979 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d8823577-a79a-4c29-9aaa-dd338aaa4bbc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.157213 Sep 22 22:24:26.520533 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 554/1143] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:26 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:27.545853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:27.546465 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:27.553053 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:27.553568 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:27.554004 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:27.554698 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:27.555149 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:27.555571 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:27.683117 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:27.691249 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:27.692687 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:27.693875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d090401-c1b6-42ce-a6ac-020d555880f4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.151958 Sep 22 22:24:27.694441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 590/1144] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:27 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:28.719816 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:28.720431 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:28.726811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:28.727302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:28.727738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:28.728435 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:28.728889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:28.729344 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:28.860320 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:28.868303 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:28.869763 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:28.870913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1aa32790-de9a-4cce-9122-bbef864a62a4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.155846 Sep 22 22:24:28.871473 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 555/1145] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:28 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:29.896454 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:29.897060 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:29.903442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:29.903927 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:29.904359 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:29.905195 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:29.905679 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:29.906101 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:30.042926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:30.051271 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:30.052879 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:30.054103 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a32e0c50-d696-4967-89f7-fd49a372b6db tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.161577 Sep 22 22:24:30.054922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 591/1146] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:29 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:31.081216 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:31.081846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:31.088407 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:31.088887 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:31.089355 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:31.090039 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:31.090489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:31.090907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:31.224343 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:31.232246 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:31.234006 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:31.235156 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-9c556b94-2974-4a4b-ad1c-d88a2a4e1d70 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.158784 Sep 22 22:24:31.235711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 556/1147] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:31 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:32.260622 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:32.261297 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:32.268319 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:32.268806 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:32.269289 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:32.269985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:32.270443 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:32.270867 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:32.399853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:32.408333 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:32.409788 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:32.410945 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-a15dca32-5e1e-45d9-8242-1b83c3812f94 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.154240 Sep 22 22:24:32.411504 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 592/1148] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:32 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:33.436292 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:33.436928 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:33.443994 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:33.444476 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:33.444913 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:33.445639 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:33.446093 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:33.446517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:33.576068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:33.584675 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:33.586158 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:33.587319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cd87a98c-0fcf-4ffe-a0da-6ea96d353690 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.154959 Sep 22 22:24:33.587879 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 557/1149] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:33 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:34.612687 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:34.613300 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:34.619681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:34.620154 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:34.620583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:34.621299 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:34.621748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:34.622166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:34.752878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:34.760900 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:34.762391 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:34.763549 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e18d5ffd-9235-4d5f-bf64-f9f0f6ddded5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1745 microversion: 2.20 time: 0.154884 Sep 22 22:24:34.764105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 593/1150] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:34 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:35.790863 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:35.791461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:35.798700 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:35.799177 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:35.799611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:35.800301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:35.800758 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:35.801206 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:35.931117 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:35.939133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:35.940574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:35.941769 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-df840924-8716-4d69-9ab5-cfcf7062334a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1745 microversion: 2.20 time: 0.154952 Sep 22 22:24:35.942333 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 558/1151] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:35 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:36.968136 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:36.968678 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:36.975785 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:36.976275 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:36.976715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:36.977442 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:36.977896 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:36.978317 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:37.109331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:37.117425 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:37.118886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:37.120036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-72968635-a2d9-485f-b182-d4615ec91f7b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1745 microversion: 2.20 time: 0.156036 Sep 22 22:24:37.120591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 594/1152] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:36 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:38.145882 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:38.146517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:38.152554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:38.153032 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:38.153540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:38.154245 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:38.154681 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:38.155103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:38.282730 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:38.290779 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:38.292217 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:38.293397 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-0ee00d95-5f99-4954-b927-f43df6b91f08 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1745 microversion: 2.20 time: 0.151454 Sep 22 22:24:38.293955 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 559/1153] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:38 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:38.748802 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-fc40056e-dfb9-4dad-8408-1502aad8f347 req-ea96bb03-fac8-4949-b4df-09594e23b159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df723f-5a3d-4e8d-892e-c04622d4f50f", "name": "network-vif-plugged", "status": "completed", "tag": "6109b39c-b3b8-4d3e-b43e-90fe65c142f8"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:24:38.763035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-fc40056e-dfb9-4dad-8408-1502aad8f347 req-ea96bb03-fac8-4949-b4df-09594e23b159 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:38.764301 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-fc40056e-dfb9-4dad-8408-1502aad8f347 req-ea96bb03-fac8-4949-b4df-09594e23b159 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:38.766426 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-fc40056e-dfb9-4dad-8408-1502aad8f347 req-ea96bb03-fac8-4949-b4df-09594e23b159 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:38.781048 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-fc40056e-dfb9-4dad-8408-1502aad8f347 req-ea96bb03-fac8-4949-b4df-09594e23b159 service nova] Creating event network-vif-plugged:6109b39c-b3b8-4d3e-b43e-90fe65c142f8 for instance 66df723f-5a3d-4e8d-892e-c04622d4f50f on hv-cinder-84914 Sep 22 22:24:38.787264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-fc40056e-dfb9-4dad-8408-1502aad8f347 req-ea96bb03-fac8-4949-b4df-09594e23b159 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042716 Sep 22 22:24:38.788264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 595/1154] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:24:39.319839 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:39.320469 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:39.328068 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:39.329800 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:39.330574 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:39.331953 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:39.333015 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:39.333493 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:39.495746 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:39.508561 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:39.510038 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:39.511211 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-722ecddc-3d1d-4bdf-9502-7100396d6d74 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1740 microversion: 2.20 time: 0.195268 Sep 22 22:24:39.511765 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 560/1155] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:39 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:40.541026 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:40.542499 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:40.549879 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:40.550744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:40.551253 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:40.552034 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:40.552560 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:40.553072 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:40.697328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:40.706148 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:40.707583 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:40.708980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-2d983f70-f93d-4a73-9f3d-88bf395dd835 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1740 microversion: 2.20 time: 0.172920 Sep 22 22:24:40.725404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 596/1156] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:40 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:41.735405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:41.737082 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:41.744013 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:41.744611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:41.745347 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:41.746430 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:41.747089 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:41.747549 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:41.884837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:41.895444 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:41.897215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:41.898381 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-00738f80-7e8e-45a8-9a67-fcb5c8269413 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1740 microversion: 2.20 time: 0.167590 Sep 22 22:24:41.898936 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 561/1157] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:41 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:42.925238 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:42.925857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:42.932166 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:42.932884 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:42.933527 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:42.934491 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:42.935129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:42.935717 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:43.083280 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:43.091595 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:43.093032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:43.095652 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-d3107324-0f23-453e-bbd9-a360c09bcd62 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1740 microversion: 2.20 time: 0.175195 Sep 22 22:24:43.096228 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 597/1158] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:42 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:24:44.123495 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:44.124736 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:44.132530 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:44.133039 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:44.133494 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:44.134186 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:44.134635 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:44.135052 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:44.273664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:44.283066 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:44.284844 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:44.286180 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a496f674-3ae1-49f5-9004-fc447eb1a99e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1740 microversion: 2.20 time: 0.168972 Sep 22 22:24:44.286934 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 562/1159] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:44 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:45.315040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:45.316303 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:45.322656 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:45.323148 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:45.324073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:45.324290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:45.324749 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:45.325200 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:45.465282 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:45.474380 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:45.475810 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:45.476998 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-edcf2f69-4a77-4f04-9f4e-8338ed1337cf tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1740 microversion: 2.20 time: 0.166572 Sep 22 22:24:45.477588 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 598/1160] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:45 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:46.502705 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:46.504081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:46.510915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:46.511639 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:46.512072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:46.512769 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:46.513255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:46.513793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:46.661547 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:46.670712 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:46.672317 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:46.674819 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f06439ff-585e-4478-8d69-8f41310fbd81 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1740 microversion: 2.20 time: 0.175938 Sep 22 22:24:46.689483 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 563/1161] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:46 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:47.703878 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:47.705650 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:47.715869 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:47.716490 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:47.717308 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:47.718960 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:47.720294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:47.721376 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:47.884500 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:47.895514 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:47.897017 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:47.898237 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-70360fc2-6d0c-432f-b8f0-9ec05f21fa13 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1740 microversion: 2.20 time: 0.200106 Sep 22 22:24:47.898796 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 599/1162] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:47 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:48.925639 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:48.926215 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:48.932527 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:48.933005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:48.933468 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:48.934150 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:48.934603 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:48.935019 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:49.073544 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:49.081992 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:49.083438 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:49.084601 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-368e1e27-aa8a-4ae2-bedb-035c053b3dc4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1740 microversion: 2.20 time: 0.163581 Sep 22 22:24:49.085188 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 564/1163] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:48 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:50.111279 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:50.111900 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:50.118170 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:50.118653 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:50.119082 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:50.119772 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:50.120227 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:50.120649 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:50.250580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:50.258605 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:50.260050 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:50.261244 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c8cf7fd8-a698-4847-854f-5b51f21627b0 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1722 microversion: 2.20 time: 0.153938 Sep 22 22:24:50.261803 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 600/1164] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:50 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:51.286787 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:51.287398 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:51.293811 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:51.294295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:51.294732 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:51.295423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:51.295877 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:51.296295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:51.430942 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:51.439046 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:51.441055 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:51.442253 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-c31e38f9-078e-4b88-956a-4acb4eeb090b tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1722 microversion: 2.20 time: 0.159436 Sep 22 22:24:51.442813 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 565/1165] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:51 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:52.469254 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:52.469859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:52.472842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=29 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:24:52.478263 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:52.478742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:52.479172 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:52.479851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:52.480306 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:52.480724 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:52.483263 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=79 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:24:52.609011 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:52.617414 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:52.618868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:52.620032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-83153159-1f51-4d07-a706-be49570a0b55 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1665 microversion: 2.20 time: 0.154764 Sep 22 22:24:52.620590 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 601/1166] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:52 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:52.645304 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f3f4573d-b08a-4c30-bf32-fef279261964 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bac91ce4-d6e2-43e4-83c6-5f2d483bd75b"}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:24:52.647885 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f3f4573d-b08a-4c30-bf32-fef279261964 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:52.650304 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=29 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:24:52.656121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3f4573d-b08a-4c30-bf32-fef279261964 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:52.656611 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3f4573d-b08a-4c30-bf32-fef279261964 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:52.657043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3f4573d-b08a-4c30-bf32-fef279261964 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:52.657771 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3f4573d-b08a-4c30-bf32-fef279261964 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:52.658232 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3f4573d-b08a-4c30-bf32-fef279261964 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:52.659287 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f3f4573d-b08a-4c30-bf32-fef279261964 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:52.662131 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:24:52.757725 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-363db493-c4a6-4f32-b5c0-45b54bae85d0 req-594ed8f7-51ac-4547-b5fa-05fca5dff805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df723f-5a3d-4e8d-892e-c04622d4f50f", "name": "network-vif-unplugged", "status": "completed", "tag": "6109b39c-b3b8-4d3e-b43e-90fe65c142f8"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:24:52.769706 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-363db493-c4a6-4f32-b5c0-45b54bae85d0 req-594ed8f7-51ac-4547-b5fa-05fca5dff805 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:52.770531 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-363db493-c4a6-4f32-b5c0-45b54bae85d0 req-594ed8f7-51ac-4547-b5fa-05fca5dff805 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:52.770681 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-363db493-c4a6-4f32-b5c0-45b54bae85d0 req-594ed8f7-51ac-4547-b5fa-05fca5dff805 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:52.783612 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.compute.server_external_events [req-363db493-c4a6-4f32-b5c0-45b54bae85d0 req-594ed8f7-51ac-4547-b5fa-05fca5dff805 service nova] Unable to find a host for instance 66df723f-5a3d-4e8d-892e-c04622d4f50f. Dropping event network-vif-unplugged {{(pid=120663) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 22 22:24:52.784518 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-363db493-c4a6-4f32-b5c0-45b54bae85d0 req-594ed8f7-51ac-4547-b5fa-05fca5dff805 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031141 Sep 22 22:24:52.785293 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 602/1167] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 22 22:24:52.956350 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f3f4573d-b08a-4c30-bf32-fef279261964 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314872 Sep 22 22:24:52.956968 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 566/1168] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Sep 22 22:24:52 2022] POST /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 22:24:53.083930 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-157dae9c-a5a9-42b4-a329-b3483e20cd42 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:53.084421 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-157dae9c-a5a9-42b4-a329-b3483e20cd42 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:53.090797 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157dae9c-a5a9-42b4-a329-b3483e20cd42 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:53.091305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157dae9c-a5a9-42b4-a329-b3483e20cd42 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:53.091764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157dae9c-a5a9-42b4-a329-b3483e20cd42 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:53.092484 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157dae9c-a5a9-42b4-a329-b3483e20cd42 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:53.092932 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157dae9c-a5a9-42b4-a329-b3483e20cd42 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:53.093389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-157dae9c-a5a9-42b4-a329-b3483e20cd42 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:53.323731 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-157dae9c-a5a9-42b4-a329-b3483e20cd42 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/os-volume_attachments/bac91ce4-d6e2-43e4-83c6-5f2d483bd75b" status: 202 len: 0 microversion: 2.20 time: 0.244150 Sep 22 22:24:53.324347 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 603/1169] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Sep 22 22:24:53 2022] DELETE /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/os-volume_attachments/bac91ce4-d6e2-43e4-83c6-5f2d483bd75b => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:24:53.385945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:24:53.386538 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:53.393035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:53.393550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:53.393982 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:53.394668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:53.395122 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:53.395545 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:53.423392 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120662) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 22:24:53.488181 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [6decbb39-6ceb-4180-b244-83d11b37f0c8] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 22:24:54.495172 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [6decbb39-6ceb-4180-b244-83d11b37f0c8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34708. Sep 22 22:24:54.498207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-a86d4f66-48fd-488d-a78c-14d58a196363 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "POST /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/action" status: 202 len: 0 microversion: 2.20 time: 1.116371 Sep 22 22:24:54.498818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 567/1170] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 22 22:24:53 2022] POST /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/action => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:24:54.507357 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:54.507962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:54.514266 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:54.514744 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:54.515176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:54.515862 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:54.516309 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:54.516728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:54.660994 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:54.669670 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:54.671132 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:54.672340 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-00f7374f-14b1-441c-9ee5-34815b6a59f9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1673 microversion: 2.20 time: 0.168845 Sep 22 22:24:54.672935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 604/1171] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:54 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:55.699818 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:55.700450 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:55.708533 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:55.709617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:55.710071 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:55.710792 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:55.711255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:55.711686 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:55.841402 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:55.849501 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:55.850978 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:55.852840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cf704a3d-a2f2-47d8-abfb-11ef7fe4bca3 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.157383 Sep 22 22:24:55.853645 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 568/1172] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:55 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:56.879035 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:56.880239 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:56.886539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:56.887041 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:56.887479 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:56.888187 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:56.888643 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:56.889212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:57.100869 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:57.116737 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:57.118290 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:57.120175 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-42bac285-907c-445a-ae23-b2b126b2261e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.245099 Sep 22 22:24:57.121499 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 605/1173] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:56 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:58.148137 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:58.148839 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:58.155548 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:58.156109 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:58.156604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:58.157409 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:58.157986 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:58.158474 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:58.306076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:58.315116 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:58.317665 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:58.319639 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3d588c0c-b3b6-4340-ab3b-1cec2342a9ef tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.175174 Sep 22 22:24:58.321005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 569/1174] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:58 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:24:59.347053 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:24:59.347609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:24:59.354403 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:59.354885 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:59.355317 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:59.356036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:24:59.356487 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:24:59.356904 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:24:59.516190 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:59.525562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:59.527532 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:24:59.528751 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cc6dcea5-41ba-46c5-a8bf-fc0100b60fe6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.185659 Sep 22 22:24:59.529391 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 606/1175] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:24:59 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:00.556602 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:00.557413 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:00.564340 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:00.564821 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:00.565377 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:00.566286 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:00.566781 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:00.567203 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:00.723058 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:00.731924 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:00.733717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:00.735044 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-866e7d9e-781a-41c9-94a7-7c3333bd938a tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.182310 Sep 22 22:25:00.742423 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 570/1176] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:00 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:01.762624 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:01.763764 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:01.772899 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:01.773434 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:01.773874 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:01.774618 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:01.775078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:01.775506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:01.915980 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:01.925706 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:01.927176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:01.928378 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6f2f5885-54d8-488b-b991-7bc1ab6fb216 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.170323 Sep 22 22:25:01.928932 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 607/1177] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:01 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:02.956762 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:02.957587 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:02.963892 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:02.964464 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:02.964993 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:02.965805 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:02.966329 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:02.966755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:03.110721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:03.119651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:03.121123 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:03.122604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1dc82de9-f542-45d4-b81c-7827d262d2c1 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.170521 Sep 22 22:25:03.123489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 571/1178] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:02 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:04.150983 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:04.151609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:04.158344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:04.158902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:04.159541 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:04.160256 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:04.160774 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:04.161303 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:04.302097 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:04.310569 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:04.312016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:04.313226 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cead8106-0c14-40f6-8bf4-da39859a42c8 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.166281 Sep 22 22:25:04.313798 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 608/1179] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:04 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:05.339461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:05.340103 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:05.347109 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:05.347595 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:05.348027 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:05.348714 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:05.349197 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:05.349620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:05.479334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:05.487604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:05.489197 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:05.490358 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-16aa5df3-0026-4b39-af76-31e82633cbb6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.154915 Sep 22 22:25:05.490910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 572/1180] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:05 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:06.516742 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:06.517363 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:06.524851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:06.525374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:06.525812 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:06.526506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:06.526958 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:06.527379 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:06.655158 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:06.668875 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:06.670404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:06.671586 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-939e1f98-3437-4ff3-9af3-43a5bdb4e4e6 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.158780 Sep 22 22:25:06.672150 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 609/1181] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:06 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:25:07.697823 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:07.698482 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:07.705041 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:07.705549 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:07.705980 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:07.707236 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:07.707679 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:07.708096 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:07.835240 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:07.843235 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:07.844659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:07.845833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1ec75163-5101-45bf-8f74-f0c98d4df1ba tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.151945 Sep 22 22:25:07.846390 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 573/1182] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:07 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:08.872562 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:08.873208 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:08.880396 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:08.880868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:08.881328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:08.882033 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:08.882482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:08.882902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:09.022880 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:09.030839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:09.032262 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:09.033470 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-469d2ae0-ac59-4b39-b3f7-04e1eaac9c91 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.164763 Sep 22 22:25:09.034022 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 610/1183] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:08 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:10.069427 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:10.070028 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:10.075980 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:10.076448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:10.076877 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:10.077602 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:10.078303 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:10.078734 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:10.206648 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:10.214628 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:10.216090 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:10.217274 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f8065105-577d-452f-bc77-a44a639c9187 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.152470 Sep 22 22:25:10.217837 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 574/1184] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:10 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:11.244574 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:11.245190 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:11.251600 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:11.252078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:11.252510 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:11.253232 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:11.253687 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:11.254113 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:11.401014 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:11.409843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:11.411886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:11.413078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-99128fbf-7037-4271-92e0-e5f69f7ff9d9 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.172486 Sep 22 22:25:11.413675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 611/1185] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:11 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:25:12.440500 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:12.441164 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:12.448076 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:12.448554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:12.448986 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:12.449865 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:12.450320 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:12.450743 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:12.579765 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:12.587829 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:12.589351 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:12.590513 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e154d389-1756-4b24-93a3-4b361654d47e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.154770 Sep 22 22:25:12.591085 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 575/1186] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:12 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:12.892305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-58ddd859-6e6f-4950-bb59-cb022bc75e0a req-8de3667b-0239-4d51-aa7c-8e6003be0725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df723f-5a3d-4e8d-892e-c04622d4f50f", "name": "network-vif-plugged", "status": "completed", "tag": "6109b39c-b3b8-4d3e-b43e-90fe65c142f8"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:25:12.902702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-58ddd859-6e6f-4950-bb59-cb022bc75e0a req-8de3667b-0239-4d51-aa7c-8e6003be0725 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:12.903176 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-58ddd859-6e6f-4950-bb59-cb022bc75e0a req-8de3667b-0239-4d51-aa7c-8e6003be0725 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:12.903602 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-58ddd859-6e6f-4950-bb59-cb022bc75e0a req-8de3667b-0239-4d51-aa7c-8e6003be0725 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:12.915184 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-58ddd859-6e6f-4950-bb59-cb022bc75e0a req-8de3667b-0239-4d51-aa7c-8e6003be0725 service nova] Creating event network-vif-plugged:6109b39c-b3b8-4d3e-b43e-90fe65c142f8 for instance 66df723f-5a3d-4e8d-892e-c04622d4f50f on hv-cinder-84914 Sep 22 22:25:12.920273 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-58ddd859-6e6f-4950-bb59-cb022bc75e0a req-8de3667b-0239-4d51-aa7c-8e6003be0725 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031549 Sep 22 22:25:12.920863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 612/1187] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:25:13.615945 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:13.616539 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:13.622940 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:13.623422 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:13.623859 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:13.624555 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:13.625005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:13.625458 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:13.760292 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:13.768362 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:13.769985 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:13.771761 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-cf569145-47e6-4c2a-bb86-975511caf44f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.159925 Sep 22 22:25:13.772353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 576/1188] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:13 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:14.798592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:14.799410 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:14.805690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:14.806164 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:14.806593 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:14.807270 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:14.807719 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:14.808137 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:15.002454 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:15.010736 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:15.012214 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:15.013396 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d270521-4e06-4987-a027-526918bbca64 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1731 microversion: 2.20 time: 0.219639 Sep 22 22:25:15.014241 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 613/1189] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:14 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:25:16.039920 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:25:16.040522 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:25:16.047186 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:16.047676 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:16.048112 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:16.048840 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:25:16.049347 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:25:16.049774 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:25:16.243689 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:16.251824 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:16.253301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:25:16.254548 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-74612778-87a7-4960-b310-484456054213 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1718 microversion: 2.20 time: 0.219034 Sep 22 22:25:16.255452 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 577/1190] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:25:16 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1718 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:26:11.529675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-7a022ce5-d99a-4e30-a848-f66d94d1f716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:11.531843 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-7a022ce5-d99a-4e30-a848-f66d94d1f716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:11.533964 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=25 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:26:11.534609 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:26:11.535829 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 22:26:11.535968 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Thu Sep 22 22:26:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/os-volume_attachments (ip 10.222.0.25) !!! Sep 22 22:26:11.549503 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a022ce5-d99a-4e30-a848-f66d94d1f716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:11.550065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a022ce5-d99a-4e30-a848-f66d94d1f716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:11.550506 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a022ce5-d99a-4e30-a848-f66d94d1f716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:11.551205 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a022ce5-d99a-4e30-a848-f66d94d1f716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:11.551655 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a022ce5-d99a-4e30-a848-f66d94d1f716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:11.552078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-7a022ce5-d99a-4e30-a848-f66d94d1f716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:11.582065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-7a022ce5-d99a-4e30-a848-f66d94d1f716 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056681 Sep 22 22:26:11.582868 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 614/1191] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 22 22:26:11 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:26:11.645918 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:11.646421 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:11.648370 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:26:11.649018 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:26:11.656980 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:11.657540 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:11.657977 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:11.658660 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:11.659107 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:11.659524 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:11.685032 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Going to try to terminate instance {{(pid=120662) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:26:11.757776 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bbe012c3-0dde-4372-86ee-bfbb02277a31 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 204 len: 0 microversion: 2.20 time: 0.115537 Sep 22 22:26:11.758584 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 578/1192] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 22 22:26:11 2022] DELETE /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 22:26:11.767143 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:11.767814 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:11.773838 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:11.774321 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:11.774773 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:11.775447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:11.775899 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:11.776323 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:11.908080 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:26:11.916105 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:26:11.917585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:26:11.918848 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-6dfe9b8b-d54b-4ed6-97d1-12428e20c6c5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.155980 Sep 22 22:26:11.920321 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 615/1193] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:26:11 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 22:26:12.946299 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:12.946983 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:12.953878 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:12.954354 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:12.954778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:12.955454 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:12.955899 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:12.956314 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:13.088460 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:26:13.097463 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:26:13.098901 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:26:13.100057 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d89004a4-2701-486c-b77f-781f43e7e67c tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1724 microversion: 2.20 time: 0.158015 Sep 22 22:26:13.100613 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 579/1194] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:26:12 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:26:14.125247 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:14.125861 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:14.132907 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:14.133580 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:14.133942 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:14.134665 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:14.135210 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:14.135587 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:14.217360 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:26:14.225570 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:26:14.226953 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b01f21ffa814a5da3873e5387938b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaff29c3c9b84929b0451e8e82caf4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:26:14.228128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-09d5c648-85ae-4f4d-9f26-9af6869f03d4 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 200 len: 1656 microversion: 2.20 time: 0.107329 Sep 22 22:26:14.228697 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 616/1195] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:26:14 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 1656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 22:26:14.443433 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-84ce02aa-d053-4221-8891-3db17ec03b92 req-92b920da-0941-455d-9925-aa971f5268bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df723f-5a3d-4e8d-892e-c04622d4f50f", "name": "network-vif-deleted", "tag": "6109b39c-b3b8-4d3e-b43e-90fe65c142f8"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:26:14.454322 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-84ce02aa-d053-4221-8891-3db17ec03b92 req-92b920da-0941-455d-9925-aa971f5268bb service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:14.454795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-84ce02aa-d053-4221-8891-3db17ec03b92 req-92b920da-0941-455d-9925-aa971f5268bb service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:14.455218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-84ce02aa-d053-4221-8891-3db17ec03b92 req-92b920da-0941-455d-9925-aa971f5268bb service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:14.467791 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-84ce02aa-d053-4221-8891-3db17ec03b92 req-92b920da-0941-455d-9925-aa971f5268bb service nova] Creating event network-vif-deleted:6109b39c-b3b8-4d3e-b43e-90fe65c142f8 for instance 66df723f-5a3d-4e8d-892e-c04622d4f50f on hv-cinder-84914 Sep 22 22:26:14.473133 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-84ce02aa-d053-4221-8891-3db17ec03b92 req-92b920da-0941-455d-9925-aa971f5268bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033279 Sep 22 22:26:14.477748 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 580/1196] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:26:15.254866 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:15.255620 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:15.262356 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:15.263185 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:15.263775 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:15.264482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:15.264935 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:15.265512 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:15.279726 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] HTTP exception thrown: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Request method failure captured: Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f HTTP/1.1 Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN82Dm2ADzy-cpy5J4LucY5HqiMRTmO5Mjx9490AF22Z00EXarB6KsLsFR8igt8tCpA_KeyfTAufqFWGqDtaFEWoRsQQU_UFModfxeHO4oDv8iHmoyhVGOJwJGmTg3RHyHUqqdpIHYM4oYCINoer2tAYefkVHJVk8NKRxH5bLSrylxE Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:26:15.281449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaff29c3c9b84929b0451e8e82caf4f2", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 1b01f21ffa814a5da3873e5387938b2a Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:15.283375 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '66df723f-5a3d-4e8d-892e-c04622d4f50f'} Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:26:15.284572 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:15.286382 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:15.288139 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Returning 404 to user: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:26:15.288139 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5a866267-770c-4520-af63-b796960ef03f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 404 len: 111 microversion: 2.20 time: 0.031913 Sep 22 22:26:15.288139 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 617/1197] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:26:15 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 22:26:15.295433 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-056950d1-d9e1-4fcb-8939-e744ad07d14f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '.version_select at 0x7f405ceb6d30>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:15.313790 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-056950d1-d9e1-4fcb-8939-e744ad07d14f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-965768241" status: 204 len: 0 microversion: 2.20 time: 0.025512 Sep 22 22:26:15.314400 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 581/1198] 10.222.0.25 () {60 vars in 1259 bytes} [Thu Sep 22 22:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-965768241 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 22:26:17.076184 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:17.076715 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:17.083386 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:17.083870 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:17.084381 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:17.084998 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:17.085521 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:17.085956 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:17.099621 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] HTTP exception thrown: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Request method failure captured: Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f HTTP/1.1 Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN82Dm2ADzy-cpy5J4LucY5HqiMRTmO5Mjx9490AF22Z00EXarB6KsLsFR8igt8tCpA_KeyfTAufqFWGqDtaFEWoRsQQU_UFModfxeHO4oDv8iHmoyhVGOJwJGmTg3RHyHUqqdpIHYM4oYCINoer2tAYefkVHJVk8NKRxH5bLSrylxE Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:26:17.101220 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaff29c3c9b84929b0451e8e82caf4f2", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 1b01f21ffa814a5da3873e5387938b2a Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.103123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '66df723f-5a3d-4e8d-892e-c04622d4f50f'} Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:26:17.104122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.105770 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.107409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Returning 404 to user: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:26:17.107409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e26d8949-1ed5-4026-a4eb-da332c6460dc tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 404 len: 111 microversion: 2.20 time: 0.031079 Sep 22 22:26:17.107409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 618/1199] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 22 22:26:17 2022] DELETE /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 22:26:17.111747 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:17.112474 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 66df723f-5a3d-4e8d-892e-c04622d4f50f] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:17.119105 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:17.119617 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:17.120052 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:17.120741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:17.121227 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:17.121653 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:17.134967 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] HTTP exception thrown: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Request method failure captured: Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f HTTP/1.1 Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN82Dm2ADzy-cpy5J4LucY5HqiMRTmO5Mjx9490AF22Z00EXarB6KsLsFR8igt8tCpA_KeyfTAufqFWGqDtaFEWoRsQQU_UFModfxeHO4oDv8iHmoyhVGOJwJGmTg3RHyHUqqdpIHYM4oYCINoer2tAYefkVHJVk8NKRxH5bLSrylxE Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:26:17.136580 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaff29c3c9b84929b0451e8e82caf4f2", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 1b01f21ffa814a5da3873e5387938b2a Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.138827 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '66df723f-5a3d-4e8d-892e-c04622d4f50f'} Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:26:17.139680 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. Sep 22 22:26:17.141079 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:17.142554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Returning 404 to user: Instance 66df723f-5a3d-4e8d-892e-c04622d4f50f could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:26:17.142554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b725ec42-91ae-45c4-9e5a-3b6feea21ab5 tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f" status: 404 len: 111 microversion: 2.20 time: 0.030587 Sep 22 22:26:17.142554 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 582/1200] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:26:17 2022] GET /compute/v2.1/servers/66df723f-5a3d-4e8d-892e-c04622d4f50f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 22:26:18.276159 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:18.276669 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:18.283824 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:18.284315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:18.285716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:18.285716 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:18.285983 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:18.286406 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:18.300337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.wsgi [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] HTTP exception thrown: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Request method failure captured: Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: request: DELETE /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 HTTP/1.1 Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept: application/json Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Accept-Encoding: identity Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Connection: close Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Length: 0 Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Content-Type: application/json Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Host: 10.222.0.25 Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Openstack-System-Scope: None Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: User-Agent: python-urllib3/1.26.12 Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Auth-Token: gAAAAABjLN82Dm2ADzy-cpy5J4LucY5HqiMRTmO5Mjx9490AF22Z00EXarB6KsLsFR8igt8tCpA_KeyfTAufqFWGqDtaFEWoRsQQU_UFModfxeHO4oDv8iHmoyhVGOJwJGmTg3RHyHUqqdpIHYM4oYCINoer2tAYefkVHJVk8NKRxH5bLSrylxE Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Id: None Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Domain-Name: None Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Identity-Status: Confirmed Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Is-Admin-Project: True Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Id: default Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Domain-Name: Default Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Role: member,reader Sep 22 22:26:18.301917 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Roles: member,reader Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaff29c3c9b84929b0451e8e82caf4f2", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Id: default Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Domain-Name: Default Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Id: 1b01f21ffa814a5da3873e5387938b2a Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: method: > Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: exception: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.303738 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: action_args: {'id': '03073c72-a5ba-4bab-90eb-f92f0396c092'} Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:26:18.304631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.306036 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.307469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Returning 404 to user: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. {{(pid=120663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:26:18.307469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b46e1a91-b9ee-410e-b2af-b8bf131f446f tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 404 len: 111 microversion: 2.20 time: 0.031075 Sep 22 22:26:18.307469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 619/1201] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 22 22:26:18 2022] DELETE /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 22:26:18.312394 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:26:18.313005 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] [instance: 03073c72-a5ba-4bab-90eb-f92f0396c092] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:26:18.319274 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:18.319739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:18.320167 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:18.320846 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:26:18.321337 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:26:18.321747 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:26:18.335533 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] HTTP exception thrown: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Request method failure captured: Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 HTTP/1.1 Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLN82Dm2ADzy-cpy5J4LucY5HqiMRTmO5Mjx9490AF22Z00EXarB6KsLsFR8igt8tCpA_KeyfTAufqFWGqDtaFEWoRsQQU_UFModfxeHO4oDv8iHmoyhVGOJwJGmTg3RHyHUqqdpIHYM4oYCINoer2tAYefkVHJVk8NKRxH5bLSrylxE Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:26:18.337030 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaff29c3c9b84929b0451e8e82caf4f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaff29c3c9b84929b0451e8e82caf4f2", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: eaff29c3c9b84929b0451e8e82caf4f2 Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-869090602 Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 1b01f21ffa814a5da3873e5387938b2a Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-AttachVolumeShelveTestJSON-869090602-project Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.338880 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '03073c72-a5ba-4bab-90eb-f92f0396c092'} Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:26:18.339930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. Sep 22 22:26:18.342364 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:26:18.343807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] Returning 404 to user: Instance 03073c72-a5ba-4bab-90eb-f92f0396c092 could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:26:18.343807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d086470d-f74e-4c23-a5b1-ed608f35531e tempest-AttachVolumeShelveTestJSON-869090602 tempest-AttachVolumeShelveTestJSON-869090602-project] 10.222.0.25 "GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092" status: 404 len: 111 microversion: 2.20 time: 0.030213 Sep 22 22:26:18.343807 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 583/1202] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 22 22:26:18 2022] GET /compute/v2.1/servers/03073c72-a5ba-4bab-90eb-f92f0396c092 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 22:26:56.410962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=12 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:26:56.413989 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=24 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:26:56.609582 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-37edfedb-76b3-4531-8b1f-0b2ed359172e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Action: 'create', calling method: .version_select at 0x7f405cc77f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1758859465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwXBUcISWQppnMjIqrJtnL2ngjTi1CDwsU2HXqUFTAx2zl8q9CJn49OvYPmNWLp3s/qOR30xjBC8v5aezkrwqGAHqDGrlcDDhFrNjDPE47/jiJpe6g4hkEJ5dVvR85GwQ=="}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:26:56.628785 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-37edfedb-76b3-4531-8b1f-0b2ed359172e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Getting quotas for project 285dd074069d48d2951a195965088521. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:26:56.632687 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.quota [None req-37edfedb-76b3-4531-8b1f-0b2ed359172e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Getting quotas for user 27bbd818457b4a20823fe0ec0601c312 and project 285dd074069d48d2951a195965088521. Resources: {'key_pairs'} {{(pid=120663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:26:56.645886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: ERROR oslo.messaging._drivers.impl_rabbit [None req-37edfedb-76b3-4531-8b1f-0b2ed359172e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [3fe0809d-545a-4f2f-a3b9-d21e8377593c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 22:26:57.652921 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [None req-37edfedb-76b3-4531-8b1f-0b2ed359172e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [3fe0809d-545a-4f2f-a3b9-d21e8377593c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35408. Sep 22 22:26:57.667596 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-37edfedb-76b3-4531-8b1f-0b2ed359172e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.270434 Sep 22 22:26:57.668206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 620/1203] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 22 22:26:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:27:19.335890 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:27:19.336698 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:27:19.341416 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-55352987", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1758859465", "security_groups": [{"name": "tempest-secgroup-smoke-1852612941"}], "networks": [{"uuid": "9cfdaa3b-3b51-471a-a47b-8a3e118b84a3"}], "block_device_mapping_v2": [{"uuid": "331a4376-a7fb-4439-b4bc-20e867b7abc8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:27:19.457129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.network.neutron [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] validate_networks() for [('9cfdaa3b-3b51-471a-a47b-8a3e118b84a3', None, None, None, None, None)] {{(pid=120662) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 22:27:19.917136 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Flavor limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 22:27:19.917565 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Image limits 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 22:27:19.918034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Flavor pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 22:27:19.918436 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Image pref 0:0:0 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 22:27:19.918844 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.virt.hardware [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120662) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 22:27:19.928284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:19.928792 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:19.929264 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:19.929995 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:19.930451 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:19.930904 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:19.947907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Getting quotas for project 285dd074069d48d2951a195965088521. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 22:27:19.951808 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.quota [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Getting quotas for user 27bbd818457b4a20823fe0ec0601c312 and project 285dd074069d48d2951a195965088521. Resources: {'ram', 'cores', 'instances'} {{(pid=120662) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 22:27:20.010145 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Going to run 1 instances... {{(pid=120662) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 22:27:20.012283 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='331a4376-a7fb-4439-b4bc-20e867b7abc8',volume_size=None,volume_type=None)] {{(pid=120662) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 22:27:20.142359 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b38ccc5a-4b30-4622-b366-542bed6627fa tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.808431 Sep 22 22:27:20.143176 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 584/1204] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 22 22:27:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 22:27:20.154078 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-10148a48-b463-4b29-958b-e770841d178c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:20.154783 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-10148a48-b463-4b29-958b-e770841d178c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:20.160331 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=4 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:27:20.161020 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:27:20.217444 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-10148a48-b463-4b29-958b-e770841d178c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:20.225734 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-10148a48-b463-4b29-958b-e770841d178c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1087 microversion: 2.1 time: 0.075586 Sep 22 22:27:20.226305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 621/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:20 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:21.250037 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:21.250657 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:21.257353 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:21.257833 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:21.258264 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:21.258950 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:21.259445 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:21.259867 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:21.368535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:21.377206 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-fddd3692-f5ec-4a7f-9bea-3310a59d7000 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1193 microversion: 2.1 time: 0.131981 Sep 22 22:27:21.378385 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 585/1206] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:21 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1193 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:27:22.400341 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:22.400943 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:22.408636 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:22.409224 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:22.409663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:22.410419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:22.410940 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:22.411407 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:22.605842 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:22.614009 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5776acd8-238b-4b85-80b6-4ec1708c7cdb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.217599 Sep 22 22:27:22.614592 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 622/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:22 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:22.993756 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-57a58934-ec87-41bf-825a-6666130fa39b req-ab075602-369d-4c3c-b3cc-cd8d53d45b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88352e2f-3ff2-4c9c-bea4-c8a206884b2a", "tag": "3259b98e-bd80-43d7-9756-66370d9a2f5a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:27:23.003307 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-57a58934-ec87-41bf-825a-6666130fa39b req-ab075602-369d-4c3c-b3cc-cd8d53d45b50 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:23.003789 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-57a58934-ec87-41bf-825a-6666130fa39b req-ab075602-369d-4c3c-b3cc-cd8d53d45b50 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:23.004225 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-57a58934-ec87-41bf-825a-6666130fa39b req-ab075602-369d-4c3c-b3cc-cd8d53d45b50 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:23.014860 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-57a58934-ec87-41bf-825a-6666130fa39b req-ab075602-369d-4c3c-b3cc-cd8d53d45b50 service nova] Creating event network-changed:3259b98e-bd80-43d7-9756-66370d9a2f5a for instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a on hv-cinder-84914 Sep 22 22:27:23.022453 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-57a58934-ec87-41bf-825a-6666130fa39b req-ab075602-369d-4c3c-b3cc-cd8d53d45b50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100081 Sep 22 22:27:23.023082 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 586/1208] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:27:23.637902 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:23.638517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:23.644982 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:23.645501 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:23.645943 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:23.646635 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:23.647091 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:23.647517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:23.779063 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:23.786748 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-5873707b-8f67-49da-8104-4f3c01a4b192 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.152750 Sep 22 22:27:23.787316 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 623/1209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:23 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:24.811178 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:24.811906 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:24.818741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:24.819281 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:24.819775 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:24.820461 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:24.820953 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:24.821453 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:24.957519 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:24.965419 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-831130bf-50e9-46f3-9caa-97fc739440d5 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.158897 Sep 22 22:27:24.965991 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 587/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:24 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:25.988863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:25.989536 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:25.995922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:25.996404 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:25.996837 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:25.997563 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:25.998017 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:25.998440 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:26.131791 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:26.139383 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-cb691cfd-4ad1-4592-8b95-cbb0babb5846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.154526 Sep 22 22:27:26.139944 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 624/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:25 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:27.163201 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:27.163804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:27.170148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:27.170622 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:27.171047 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:27.171725 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:27.172207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:27.172626 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:27.301334 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:27.308976 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-afe9522f-2123-47d0-8000-802ff1224085 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.149566 Sep 22 22:27:27.309505 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 588/1212] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:27 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:28.332100 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:28.332677 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:28.339337 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:28.339828 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:28.340264 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:28.340952 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:28.341447 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:28.341876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:28.473286 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:28.480876 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e12829bd-063a-4251-90f0-875145d5cacf tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.152866 Sep 22 22:27:28.481482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 625/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:28 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:29.504612 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:29.505295 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:29.511820 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:29.512302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:29.512737 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:29.513456 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:29.513914 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:29.514336 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:29.647183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:29.654745 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-906d3b66-3df2-4137-a8b7-2e25d43e3dde tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.154624 Sep 22 22:27:29.655314 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 589/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:29 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:27:30.676996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:30.677673 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:30.679998 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell0:SELECT=2 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:27:30.685335 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:30.685821 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:30.686250 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:30.686934 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:30.687387 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:30.687811 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:30.815004 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:30.822639 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-da6010b9-55be-42da-9736-fdb547745f25 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.149560 Sep 22 22:27:30.823198 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 626/1215] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:30 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:31.846995 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:31.847588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:31.849544 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=2 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:27:31.850207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell0:SELECT=6 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:27:31.856803 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:31.857320 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:31.857755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:31.858448 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:31.858902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:31.859327 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:31.992806 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:32.000521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1e61069b-7eaf-41ab-96bf-773cb9d502f0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.158180 Sep 22 22:27:32.001087 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 590/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:31 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:33.023436 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:33.024043 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:33.030389 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:33.030873 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:33.031304 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:33.031986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:33.032430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:33.032863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:33.161342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:33.169015 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-1d7bee98-5728-4744-a76f-e0753b0a3045 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.149403 Sep 22 22:27:33.169605 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 627/1217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:33 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:34.192509 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:34.193159 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:34.199439 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:34.199930 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:34.200370 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:34.201072 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:34.201564 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:34.201991 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:34.334398 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:34.342349 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-377975ea-604f-4f44-b20c-ca902bfcc247 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.154376 Sep 22 22:27:34.342910 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 591/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:34 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:27:35.365656 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:35.366219 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:35.372603 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:35.373122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:35.373563 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:35.374245 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:35.374700 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:35.375128 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:35.512695 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:35.520984 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b5b623f3-3754-4484-a486-a4768340d181 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.159598 Sep 22 22:27:35.521696 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 628/1219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:35 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:35.637482 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-54882b02-a3a2-4214-bd61-533e84cf9c84 req-bd85fa84-85da-4c98-bc0e-78fe4260b2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88352e2f-3ff2-4c9c-bea4-c8a206884b2a", "name": "network-vif-plugged", "status": "completed", "tag": "3259b98e-bd80-43d7-9756-66370d9a2f5a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:27:35.647083 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-54882b02-a3a2-4214-bd61-533e84cf9c84 req-bd85fa84-85da-4c98-bc0e-78fe4260b2c5 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:35.647550 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-54882b02-a3a2-4214-bd61-533e84cf9c84 req-bd85fa84-85da-4c98-bc0e-78fe4260b2c5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:35.647974 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-54882b02-a3a2-4214-bd61-533e84cf9c84 req-bd85fa84-85da-4c98-bc0e-78fe4260b2c5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:35.658740 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-54882b02-a3a2-4214-bd61-533e84cf9c84 req-bd85fa84-85da-4c98-bc0e-78fe4260b2c5 service nova] Creating event network-vif-plugged:3259b98e-bd80-43d7-9756-66370d9a2f5a for instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a on hv-cinder-84914 Sep 22 22:27:35.663543 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-54882b02-a3a2-4214-bd61-533e84cf9c84 req-bd85fa84-85da-4c98-bc0e-78fe4260b2c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086802 Sep 22 22:27:35.664115 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 592/1220] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:27:36.544438 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:36.545074 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:36.551642 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:36.552120 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:36.552557 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:36.553274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:36.553724 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:36.554141 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:36.685122 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:36.693284 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-0e35ba90-7d19-434e-8a9b-eb8ae3c8f46c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1259 microversion: 2.1 time: 0.152656 Sep 22 22:27:36.693845 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 629/1221] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:36 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:37.719588 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:37.720277 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:37.727403 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:37.727892 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:37.728374 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:37.729067 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:37.729547 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:37.729969 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:37.858994 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:37.867218 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-e15af9a8-cf02-47ab-a06a-dbff6bcb8f73 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1443 microversion: 2.1 time: 0.152349 Sep 22 22:27:37.867795 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 593/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:37 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:37.889246 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:27:37.889857 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:27:37.896749 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:37.897272 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:37.897714 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:37.898430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:37.898882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:37.899305 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:38.031517 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:27:38.040027 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-e94cec80-6418-48ac-9fbc-5cfb5ff15544 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1443 microversion: 2.1 time: 0.154650 Sep 22 22:27:38.040591 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 630/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:27:37 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:27:39.864579 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-a686895c-92c4-4920-91ea-ee4d1b1d84ff req-8a5ba885-85db-4b90-a15d-a8701bca59f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88352e2f-3ff2-4c9c-bea4-c8a206884b2a", "tag": "3259b98e-bd80-43d7-9756-66370d9a2f5a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:27:39.874677 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a686895c-92c4-4920-91ea-ee4d1b1d84ff req-8a5ba885-85db-4b90-a15d-a8701bca59f5 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:27:39.875156 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a686895c-92c4-4920-91ea-ee4d1b1d84ff req-8a5ba885-85db-4b90-a15d-a8701bca59f5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:27:39.875648 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-a686895c-92c4-4920-91ea-ee4d1b1d84ff req-8a5ba885-85db-4b90-a15d-a8701bca59f5 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:27:39.887255 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-a686895c-92c4-4920-91ea-ee4d1b1d84ff req-8a5ba885-85db-4b90-a15d-a8701bca59f5 service nova] Creating event network-changed:3259b98e-bd80-43d7-9756-66370d9a2f5a for instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a on hv-cinder-84914 Sep 22 22:27:39.892500 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-a686895c-92c4-4920-91ea-ee4d1b1d84ff req-8a5ba885-85db-4b90-a15d-a8701bca59f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031736 Sep 22 22:27:39.893638 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 594/1224] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:29:53.560335 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=22 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:29:53.561081 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=54 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:29:53.562316 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 22:29:53.562494 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Thu Sep 22 22:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a/action (ip 10.222.0.25) !!! Sep 22 22:29:53.564323 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 22 22:29:53.564469 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Thu Sep 22 22:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a/action (ip 10.222.0.25) !!! Sep 22 22:29:53.572016 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:29:53.572926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:29:53.583923 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:53.584402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:53.584837 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:53.585561 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:53.586011 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:53.586432 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:53.611839 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.objects.instance [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lazy-loading 'flavor' on Instance uuid 88352e2f-3ff2-4c9c-bea4-c8a206884b2a {{(pid=120663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 22:29:53.682279 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9785ac81-6066-4dec-aabe-4b1345bb5abb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "POST /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a/action" status: 202 len: 0 microversion: 2.1 time: 0.123645 Sep 22 22:29:53.682863 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 631/1225] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:29:53 2022] POST /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 22:29:53.689035 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a93e37b-f9e9-4829-a8fb-5a342c1c50cd] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 22:29:53.689651 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:29:53.690374 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=50 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:29:53.692219 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 22 22:29:53.692357 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Thu Sep 22 22:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a (ip 10.222.0.25) !!! Sep 22 22:29:53.700499 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:29:53.701222 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:29:53.711315 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:53.711793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:53.712762 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:53.713486 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:53.713939 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:53.714370 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:53.847425 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:29:53.856157 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f166965a-bfcc-4496-bc18-be4491080b77 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.168861 Sep 22 22:29:53.856737 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 595/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:29:53 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:29:54.881259 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:29:54.881956 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:29:54.888146 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:54.888631 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:54.889068 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:54.889789 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:54.890249 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:54.890678 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:55.023059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:29:55.031278 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b2ca8efc-3cd9-46c3-9888-e9fe36190a51 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.154870 Sep 22 22:29:55.031846 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 632/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:29:54 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:29:56.055121 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:29:56.055738 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:29:56.065691 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:56.066180 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:56.066606 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:56.067319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:56.067776 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:56.068193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:56.085535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a93e37b-f9e9-4829-a8fb-5a342c1c50cd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35658. Sep 22 22:29:56.201583 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:29:56.209221 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-ad1f234c-9fec-4d66-bf59-1ef70e1e67da tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.158005 Sep 22 22:29:56.209783 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 596/1228] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:29:56 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:29:57.236986 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:29:57.237639 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:29:57.244269 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:57.244753 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:57.245230 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:57.245953 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:57.246407 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:57.246825 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:57.375268 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:29:57.382859 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-05ad430d-9df7-4bf2-a0a4-b47531bfff48 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.149813 Sep 22 22:29:57.383430 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 633/1229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:29:57 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:29:58.406830 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:29:58.407395 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:29:58.413668 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:58.414148 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:58.414582 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:58.415271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:58.415751 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:58.416171 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:58.550919 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:29:58.558800 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-d7f0a482-6ac7-4ccf-9e43-bb22b39ff12f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.156020 Sep 22 22:29:58.559371 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 597/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:29:58 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:29:59.583374 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:29:59.583990 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:29:59.591064 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:59.591545 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:59.591978 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:59.592663 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:29:59.593129 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:29:59.593585 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:29:59.721793 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:29:59.729904 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-ec1e3143-84d8-4959-9c89-55c64fbf2d08 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.150450 Sep 22 22:29:59.730478 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 634/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:29:59 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:00.753902 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:00.754505 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:00.760799 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:00.761302 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:00.761730 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:00.762407 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:00.762853 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:00.763269 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:00.900712 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:00.908608 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-b37f7b73-c21f-4307-901b-663fe628ba2a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.158529 Sep 22 22:30:00.909191 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 598/1232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:00 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:01.932760 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:01.933383 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:01.939696 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:01.940173 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:01.940641 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:01.941344 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:01.941796 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:01.942212 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:02.072064 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:02.079848 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-51870ae9-bb90-42ce-afaf-e2deb71cd04a tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.151490 Sep 22 22:30:02.080419 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 635/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:01 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:03.103681 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:03.104325 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:03.111014 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:03.111496 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:03.111921 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:03.112605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:03.113051 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:03.113572 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:03.244577 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:03.252568 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-8da2efa2-d51c-4788-b3eb-08eaa3a5f8f1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.153095 Sep 22 22:30:03.253143 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 599/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:03 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 22:30:04.276686 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:04.277250 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:04.283661 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:04.284144 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:04.284576 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:04.285309 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:04.285774 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:04.286191 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:04.505934 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:04.514125 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-25bdab71-c54e-4a5d-9c11-86932a139dae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.241511 Sep 22 22:30:04.514702 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 636/1235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:04 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:05.537533 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:05.538173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:05.545478 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:05.545957 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:05.546388 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:05.547069 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:05.547517 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:05.547937 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:05.676110 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:05.683773 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-bd0c5b27-d77d-4db3-a2eb-251da71079e1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.150115 Sep 22 22:30:05.684336 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 600/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:05 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:06.707158 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:06.707694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:06.714040 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:06.714512 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:06.714944 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:06.715872 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:06.716314 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:06.716730 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:06.853762 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:06.861743 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b0daa956-1cf1-400d-812e-dc4a3e28d61d tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1568 microversion: 2.1 time: 0.158523 Sep 22 22:30:06.862357 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 637/1237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:06 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:06.885203 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:30:06.885849 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:06.892141 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:06.892619 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:06.893050 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:06.893756 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:06.894204 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:06.894621 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:06.924535 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120662) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 22:30:06.991459 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR oslo.messaging._drivers.impl_rabbit [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [6decbb39-6ceb-4180-b244-83d11b37f0c8] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 22:30:07.998047 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [6decbb39-6ceb-4180-b244-83d11b37f0c8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35684. Sep 22 22:30:08.001695 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-25196aae-e460-48b3-9631-e43a5c6c3b40 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "POST /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a/action" status: 202 len: 0 microversion: 2.1 time: 1.120459 Sep 22 22:30:08.002304 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 601/1238] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 22 22:30:06 2022] POST /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a/action => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 22:30:08.011993 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:08.012615 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:08.018944 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:08.019423 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:08.019853 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:08.020539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:08.021032 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:08.021690 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:08.154750 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:08.162566 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c547be9b-cdf8-4c30-b7ba-1bdf4fae34c1 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1516 microversion: 2.1 time: 0.156015 Sep 22 22:30:08.163134 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 638/1239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:08 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:09.187893 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:09.188605 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:09.195562 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:09.196052 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:09.196526 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:09.197872 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:09.198319 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:09.198750 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:09.336643 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:09.345042 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-70e6e7b0-d7a3-4dfd-b94a-def2a612b7f6 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1516 microversion: 2.1 time: 0.161904 Sep 22 22:30:09.345664 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 602/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:09 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:10.368823 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:10.369735 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:10.376068 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:10.376559 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:10.377023 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:10.377754 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:10.378488 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:10.378922 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:10.402138 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-8f126572-3bbb-4ad5-b20c-3c074e8652d4 req-0c52da84-4a58-4acb-ae10-a12ef56ab6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88352e2f-3ff2-4c9c-bea4-c8a206884b2a", "name": "network-vif-unplugged", "status": "completed", "tag": "3259b98e-bd80-43d7-9756-66370d9a2f5a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:30:10.413803 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8f126572-3bbb-4ad5-b20c-3c074e8652d4 req-0c52da84-4a58-4acb-ae10-a12ef56ab6c8 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:10.414281 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8f126572-3bbb-4ad5-b20c-3c074e8652d4 req-0c52da84-4a58-4acb-ae10-a12ef56ab6c8 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:10.415115 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-8f126572-3bbb-4ad5-b20c-3c074e8652d4 req-0c52da84-4a58-4acb-ae10-a12ef56ab6c8 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:10.429649 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.compute.server_external_events [req-8f126572-3bbb-4ad5-b20c-3c074e8652d4 req-0c52da84-4a58-4acb-ae10-a12ef56ab6c8 service nova] Unable to find a host for instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a. Dropping event network-vif-unplugged {{(pid=120662) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 22 22:30:10.430843 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-8f126572-3bbb-4ad5-b20c-3c074e8652d4 req-0c52da84-4a58-4acb-ae10-a12ef56ab6c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034353 Sep 22 22:30:10.431778 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 603/1241] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 22 22:30:10.544608 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:10.552400 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-dfd57fca-2803-446b-b973-e2d65d0537ef tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1516 microversion: 2.1 time: 0.187692 Sep 22 22:30:10.552962 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 639/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:10 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:11.575742 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:11.576352 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:11.582689 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:11.583161 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:11.583590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:11.584277 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:11.584726 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:11.585173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:11.713696 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:11.721604 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5a261e3c-b8df-4ad3-9542-2eaf2981a9b0 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1516 microversion: 2.1 time: 0.149626 Sep 22 22:30:11.722173 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 604/1243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:11 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:12.745533 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:12.746020 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:12.752530 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:12.753013 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:12.753486 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:12.754180 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:12.754632 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:12.755053 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:12.901947 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:12.909606 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-9f32b7b3-7e37-4b1c-bf62-61e96f55da62 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1518 microversion: 2.1 time: 0.168328 Sep 22 22:30:12.910177 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 640/1244] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:12 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:13.932823 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:13.933469 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:13.939889 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:13.940374 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:13.940804 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:13.941521 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:13.941971 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:13.942386 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:14.147731 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:14.155741 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-545d93da-a3bf-48d8-9784-343bb27a210e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.227334 Sep 22 22:30:14.156317 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 605/1245] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:13 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:15.179882 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:15.180482 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:15.191433 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:15.191851 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:15.192282 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:15.192969 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:15.193449 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:15.193865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:15.382275 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:15.389867 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-c48e4517-9a12-43ee-88ea-2409ca429817 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.213965 Sep 22 22:30:15.390426 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 641/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:15 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:16.413575 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:16.414135 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:16.422481 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:16.422958 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:16.423391 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:16.424080 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:16.424532 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:16.424980 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:16.659620 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:16.668653 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-f166d0f8-5799-4526-b74d-6ad9e2766acb tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.258922 Sep 22 22:30:16.669211 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 606/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:16 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:17.695844 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:17.697203 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:17.703832 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:17.704312 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:17.704792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:17.705539 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:17.705985 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:17.706402 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:17.842477 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:17.850484 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-86dfe450-cc6e-4737-98f6-a9390a185578 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.158550 Sep 22 22:30:17.851050 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 642/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:17 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:18.875646 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:18.876405 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:18.884083 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:18.884591 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:18.885129 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:18.885836 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:18.886293 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:18.886717 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:19.027821 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:19.035515 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-1c4f65ce-949c-4cc8-91cc-73d2faf37ace tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.163818 Sep 22 22:30:19.036081 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 607/1249] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:18 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:20.060329 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:20.060937 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:20.067294 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:20.067712 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:20.068141 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:20.068830 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:20.069308 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:20.069728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:20.208996 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:20.217075 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-03010e3c-56c6-476c-97e9-2a05fb301521 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.161409 Sep 22 22:30:20.217728 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 643/1250] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:20 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:21.239715 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:21.240317 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:21.246803 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:21.247284 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:21.247711 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:21.248393 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:21.248838 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:21.249288 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:21.379726 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:21.387464 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-14fc602a-00df-4e45-adc2-5ea1134bd8a7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.151578 Sep 22 22:30:21.388034 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 608/1251] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:21 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:22.411206 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:22.411847 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:22.418837 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:22.419328 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:22.419768 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:22.420459 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:22.420944 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:22.421415 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:22.559019 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:22.566735 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-f487e06e-5ba4-46cb-88ed-7625d16a46c7 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.159342 Sep 22 22:30:22.567315 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 644/1252] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:22 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:23.590950 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:23.591590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:23.598489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:23.599018 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:23.599551 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:23.600273 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:23.600749 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:23.601179 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:23.734932 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:23.738419 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:30:23.743529 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-5b433d83-a14e-46b9-8157-104e79e6875c tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.157179 Sep 22 22:30:23.744195 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 609/1253] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:23 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:24.536409 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [req-537ce3ec-fde9-4d5a-b5bf-05fce1066199 req-05f03a58-03c5-4fb0-bd5b-0b9af4742278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88352e2f-3ff2-4c9c-bea4-c8a206884b2a", "name": "network-vif-plugged", "status": "completed", "tag": "3259b98e-bd80-43d7-9756-66370d9a2f5a"}]} {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:30:24.542704 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=29 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:30:24.549006 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-537ce3ec-fde9-4d5a-b5bf-05fce1066199 req-05f03a58-03c5-4fb0-bd5b-0b9af4742278 service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:24.549493 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-537ce3ec-fde9-4d5a-b5bf-05fce1066199 req-05f03a58-03c5-4fb0-bd5b-0b9af4742278 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:24.549926 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [req-537ce3ec-fde9-4d5a-b5bf-05fce1066199 req-05f03a58-03c5-4fb0-bd5b-0b9af4742278 service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:24.553919 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:30:24.562961 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.compute.server_external_events [req-537ce3ec-fde9-4d5a-b5bf-05fce1066199 req-05f03a58-03c5-4fb0-bd5b-0b9af4742278 service nova] Creating event network-vif-plugged:3259b98e-bd80-43d7-9756-66370d9a2f5a for instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a on hv-cinder-84914 Sep 22 22:30:24.568237 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [req-537ce3ec-fde9-4d5a-b5bf-05fce1066199 req-05f03a58-03c5-4fb0-bd5b-0b9af4742278 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035507 Sep 22 22:30:24.568999 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 645/1254] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:30:24.768383 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:24.769080 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:24.771590 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:30:24.779721 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:24.780278 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:24.780794 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:24.781806 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:24.782441 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:24.783016 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:24.966628 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:24.974489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-27586f93-a3ec-4dd5-bdfa-e30c15e76f90 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.211454 Sep 22 22:30:24.975061 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 610/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:24 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:26.000538 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:26.001276 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:26.008648 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:26.009157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:26.009599 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:26.010604 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:26.011073 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:26.011504 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:26.154274 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:26.162119 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-58fac468-cb85-45f8-88cf-c2f1c21c79ae tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1574 microversion: 2.1 time: 0.167130 Sep 22 22:30:26.162684 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 646/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:25 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:30:27.186855 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:30:27.187463 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:30:27.193573 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:27.194054 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:27.194489 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:27.195207 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:30:27.195661 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:30:27.196082 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:30:27.330059 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:30:27.337706 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-3221a4cf-8367-4c74-9d01-b4ec11400008 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1561 microversion: 2.1 time: 0.155030 Sep 22 22:30:27.338270 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 611/1257] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:30:27 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:31:54.958123 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:31:54.958669 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:31:54.959907 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-4558512a-73aa-4363-bf06-64bfbe6c7a85 req-6c4f8a7a-4454-4ac4-a7d8-9816b109e36a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88352e2f-3ff2-4c9c-bea4-c8a206884b2a", "tag": "3259b98e-bd80-43d7-9756-66370d9a2f5a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:31:54.961772 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_api:SELECT=3 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:31:54.962578 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG dbcounter [-] [120663] Writing DB stats nova_cell1:SELECT=7 {{(pid=120663) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:31:54.963965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 22:31:54.963965 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: Thu Sep 22 22:31:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a (ip 10.222.0.25) !!! Sep 22 22:31:54.966189 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_api:SELECT=3 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:31:54.967248 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG dbcounter [-] [120662] Writing DB stats nova_cell1:SELECT=13 {{(pid=120662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 22:31:54.968370 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 22:31:54.968586 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Thu Sep 22 22:31:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 22 22:31:54.977430 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4558512a-73aa-4363-bf06-64bfbe6c7a85 req-6c4f8a7a-4454-4ac4-a7d8-9816b109e36a service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:54.978271 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4558512a-73aa-4363-bf06-64bfbe6c7a85 req-6c4f8a7a-4454-4ac4-a7d8-9816b109e36a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:54.978410 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-4558512a-73aa-4363-bf06-64bfbe6c7a85 req-6c4f8a7a-4454-4ac4-a7d8-9816b109e36a service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:54.982810 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:54.984727 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:54.985277 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:54.985997 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:54.986465 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:54.986894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:54.993673 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-4558512a-73aa-4363-bf06-64bfbe6c7a85 req-6c4f8a7a-4454-4ac4-a7d8-9816b109e36a service nova] Creating event network-changed:3259b98e-bd80-43d7-9756-66370d9a2f5a for instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a on hv-cinder-84914 Sep 22 22:31:55.000183 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-4558512a-73aa-4363-bf06-64bfbe6c7a85 req-6c4f8a7a-4454-4ac4-a7d8-9816b109e36a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044568 Sep 22 22:31:55.001209 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 612/1258] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:31:55.015614 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Going to try to terminate instance {{(pid=120663) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 22:31:55.107463 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-fd3014f0-2aa4-4c2b-b0ee-38d4ba0bf86f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 204 len: 0 microversion: 2.1 time: 0.152677 Sep 22 22:31:55.108700 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 647/1259] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 22 22:31:54 2022] DELETE /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 22:31:55.118301 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:31:55.119214 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:31:55.130146 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:55.130739 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:55.131249 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:55.132017 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:55.132543 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:55.133038 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:55.304852 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.policy [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120662) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:31:55.314043 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-827075ee-b673-443e-b846-010b58042d71 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.200178 Sep 22 22:31:55.314626 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 613/1260] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:31:55 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:31:56.384044 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:31:56.384827 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:31:56.391886 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:56.392432 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:56.392865 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:56.393792 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:56.394242 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:56.394694 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:56.537654 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:31:56.545450 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-074c273f-b65d-4fd2-a6bb-5a5eb8de354e tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1567 microversion: 2.1 time: 0.211637 Sep 22 22:31:56.546008 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 648/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:31:56 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:31:57.382062 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [req-7752cc2a-23ab-4bde-a6e8-716f799d7f6d req-27b97846-d2f8-488a-8223-e4a9b332d0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88352e2f-3ff2-4c9c-bea4-c8a206884b2a", "name": "network-vif-deleted", "tag": "3259b98e-bd80-43d7-9756-66370d9a2f5a"}]} {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 22:31:57.392397 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7752cc2a-23ab-4bde-a6e8-716f799d7f6d req-27b97846-d2f8-488a-8223-e4a9b332d0ab service nova] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:57.392802 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7752cc2a-23ab-4bde-a6e8-716f799d7f6d req-27b97846-d2f8-488a-8223-e4a9b332d0ab service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:57.393266 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [req-7752cc2a-23ab-4bde-a6e8-716f799d7f6d req-27b97846-d2f8-488a-8223-e4a9b332d0ab service nova] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:57.405193 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.compute.server_external_events [req-7752cc2a-23ab-4bde-a6e8-716f799d7f6d req-27b97846-d2f8-488a-8223-e4a9b332d0ab service nova] Creating event network-vif-deleted:3259b98e-bd80-43d7-9756-66370d9a2f5a for instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a on hv-cinder-84914 Sep 22 22:31:57.410653 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [req-7752cc2a-23ab-4bde-a6e8-716f799d7f6d req-27b97846-d2f8-488a-8223-e4a9b332d0ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032231 Sep 22 22:31:57.411311 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 614/1262] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 22 22:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 22:31:57.570441 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:31:57.571050 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.compute.api [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120663) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:31:57.577979 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:57.578462 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:57.578894 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:57.579611 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:57.580065 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:57.580489 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG oslo_concurrency.lockutils [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120663) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:57.641157 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.policy [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27bbd818457b4a20823fe0ec0601c312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285dd074069d48d2951a195965088521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120663) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 22:31:57.649059 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-b5425da1-d992-400b-8310-7c69c7139846 tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 200 len: 1218 microversion: 2.1 time: 0.082341 Sep 22 22:31:57.649608 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 649/1263] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:31:57 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 22:31:58.673414 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '>' {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:31:58.674116 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.compute.api [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] [instance: 88352e2f-3ff2-4c9c-bea4-c8a206884b2a] Fetching instance by UUID {{(pid=120662) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 22:31:58.680276 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:58.680755 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:58.681221 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:58.681915 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Acquiring lock "f4830448-3328-421e-a52b-a48486017d64" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 22:31:58.682368 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 22:31:58.682793 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG oslo_concurrency.lockutils [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Lock "f4830448-3328-421e-a52b-a48486017d64" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120662) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 22:31:58.695683 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.wsgi [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] HTTP exception thrown: Instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a could not be found. Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Request method failure captured: Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: request: GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a HTTP/1.1 Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept: application/json Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Accept-Encoding: identity Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Connection: close Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Length: 0 Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Content-Type: application/json Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Host: 10.222.0.25 Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: Openstack-System-Scope: None Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: User-Agent: python-urllib3/1.26.12 Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Auth-Token: gAAAAABjLOErB0JsWENG6r75TRvREvwFVoZHFQOTOO1TKDRPJ-gUGJDh-swuI4x86s7J9swQJyce09-JiFOB7UhpAbwgJHugneWAkQraKGNtDsMJg8s1J0w5yf8H7lMEy_onX-tmDsDX18w0LBMMsrfaySN_e_6ItJoHFra0QXY2EPJFjLnjAu4 Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Id: None Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Domain-Name: None Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Identity-Status: Confirmed Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Is-Admin-Project: True Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Id: default Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Domain-Name: Default Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Id: 285dd074069d48d2951a195965088521 Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Project-Name: tempest-TestShelveInstance-3371991 Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Role: member,reader Sep 22 22:31:58.697308 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Roles: member,reader Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/285dd074069d48d2951a195965088521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/285dd074069d48d2951a195965088521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/285dd074069d48d2951a195965088521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_285dd074069d48d2951a195965088521", "adminURL": "http://10.222.0.25:8080"}]}] Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant: tempest-TestShelveInstance-3371991 Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Id: 285dd074069d48d2951a195965088521 Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-Tenant-Name: tempest-TestShelveInstance-3371991 Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User: tempest-TestShelveInstance-3371991-project Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Id: default Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Domain-Name: Default Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Id: 27bbd818457b4a20823fe0ec0601c312 Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: X-User-Name: tempest-TestShelveInstance-3371991-project Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: method: > Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: exception: Instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a could not be found. Sep 22 22:31:58.699151 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: action_args: {'id': '88352e2f-3ff2-4c9c-bea4-c8a206884b2a'} Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: {{(pid=120662) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a could not be found. Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 22:31:58.700174 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a could not be found. Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a could not be found. Sep 22 22:31:58.702075 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: ERROR nova.api.openstack.wsgi Sep 22 22:31:58.703659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: DEBUG nova.api.openstack.wsgi [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Returning 404 to user: Instance 88352e2f-3ff2-4c9c-bea4-c8a206884b2a could not be found. {{(pid=120662) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 22:31:58.703659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: INFO nova.api.openstack.requestlog [None req-2663c484-7d98-43cb-b092-1b7442ff5c2f tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a" status: 404 len: 111 microversion: 2.1 time: 0.030696 Sep 22 22:31:58.703659 dv-cinder-849143-6-iscsi devstack@n-api.service[120662]: [pid: 120662|app: 0|req: 615/1264] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 22 22:31:58 2022] GET /compute/v2.1/servers/88352e2f-3ff2-4c9c-bea4-c8a206884b2a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 22:31:58.861662 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: DEBUG nova.api.openstack.wsgi [None req-48ec6013-04ee-4523-8057-77dad048b9ec tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] Calling method '.version_select at 0x7f405c907700>' {{(pid=120663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 22:31:58.893675 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: INFO nova.api.openstack.requestlog [None req-48ec6013-04ee-4523-8057-77dad048b9ec tempest-TestShelveInstance-3371991 tempest-TestShelveInstance-3371991-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1758859465" status: 202 len: 0 microversion: 2.1 time: 0.037144 Sep 22 22:31:58.894342 dv-cinder-849143-6-iscsi devstack@n-api.service[120663]: [pid: 120663|app: 0|req: 650/1265] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Sep 22 22:31:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1758859465 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)